Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Separate extensive vector search tests and run them on push to dev and main vec-373 #52

Merged
merged 7 commits into from
Oct 10, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
81 changes: 81 additions & 0 deletions .github/workflows/extensive_vector_search_tests.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
name: Run long running vector search tests

on:
push:
branches:
- dev

jobs:
test-exhaustive-vector-search:
runs-on: ubuntu-24.04
continue-on-error: false


strategy:
matrix:
python-version: ["3.12"]


steps:
- name: Checkout code
uses: actions/checkout@v3

- name: Set up Python
uses: actions/setup-python@v2
with:
python-version: ${{ matrix.python-version }}


- name: Install dependencies
run: |
python -m pip install --upgrade pip
python setup.py
pip install -r requirements.txt
working-directory: tests


- name: Retrieve the secret and decode it to a file
env:
FEATURE_FILE: ${{ secrets.FEATURE_FILE }}
run: |
echo $FEATURE_FILE | base64 --decode > features.conf
working-directory: tests

- name: Docker Login
uses: docker/login-action@v2
with:
registry: aerospike.jfrog.io
username: ${{ secrets.JFROG_USERNAME }}
password: ${{ secrets.JFROG_PASSWORD }}


- name: Set up RANDFILE environment variable
run: echo "RANDFILE=$HOME/.rnd" >> $GITHUB_ENV

- name: Create .rnd file if it doesn't exist
run: touch $HOME/.rnd

- name: create config
run: |
assets/call_gen.sh
cat /etc/hosts
working-directory: tests

- name: Run unit tests
run: |

docker run -d --name aerospike-vector-search --network=host -p 5000:5000 -v $(pwd):/etc/aerospike-vector-search aerospike/aerospike-vector-search:0.10.0
docker run -d --name aerospike -p 3000:3000 -v .:/etc/aerospike aerospike/aerospike-server-enterprise:latest

sleep 5

python -m pytest standard -s --host 0.0.0.0 --port 5000 --extensive_vector_search -vs

mv .coverage coverage_data
working-directory: tests

- name: Upload test coverage
uses: actions/upload-artifact@v4
with:
name: coverage_exhaustive_vector_search
path: tests/coverage_data
76 changes: 1 addition & 75 deletions .github/workflows/integration_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -637,82 +637,8 @@ jobs:
name: coverage_is_load_balancer
path: tests/coverage_data

test-exhaustive-vector-search:
runs-on: ubuntu-24.04
continue-on-error: true


strategy:
matrix:
python-version: ["3.12"]


steps:
- name: Checkout code
uses: actions/checkout@v3

- name: Set up Python
uses: actions/setup-python@v2
with:
python-version: ${{ matrix.python-version }}


- name: Install dependencies
run: |
python -m pip install --upgrade pip
python setup.py
pip install -r requirements.txt
working-directory: tests


- name: Retrieve the secret and decode it to a file
env:
FEATURE_FILE: ${{ secrets.FEATURE_FILE }}
run: |
echo $FEATURE_FILE | base64 --decode > features.conf
working-directory: tests

- name: Docker Login
uses: docker/login-action@v2
with:
registry: aerospike.jfrog.io
username: ${{ secrets.JFROG_USERNAME }}
password: ${{ secrets.JFROG_PASSWORD }}


- name: Set up RANDFILE environment variable
run: echo "RANDFILE=$HOME/.rnd" >> $GITHUB_ENV

- name: Create .rnd file if it doesn't exist
run: touch $HOME/.rnd

- name: create config
run: |
assets/call_gen.sh
cat /etc/hosts
working-directory: tests

- name: Run unit tests
run: |

docker run -d --name aerospike-vector-search --network=host -p 5000:5000 -v $(pwd):/etc/aerospike-vector-search aerospike/aerospike-vector-search:0.10.0
docker run -d --name aerospike -p 3000:3000 -v .:/etc/aerospike aerospike/aerospike-server-enterprise:latest

sleep 5

python -m pytest standard -s --host 0.0.0.0 --port 5000 --extensive_vector_search --cov=aerospike_vector_search -vs

mv .coverage coverage_data
working-directory: tests

- name: Upload test coverage
uses: actions/upload-artifact@v4
with:
name: coverage_exhaustive_vector_search
path: tests/coverage_data

upload-to-codecov:
needs: [test-normal, test-tls, test-tls-auth, test-tls-auth-rbac, test-mtls, test-mtls-auth, test-mtls-auth-rbac, test-is-loadbalancer, test-exhaustive-vector-search]
needs: [test-normal, test-tls, test-tls-auth, test-tls-auth-rbac, test-mtls, test-mtls-auth, test-mtls-auth-rbac, test-is-loadbalancer]
runs-on: ubuntu-latest
steps:
- name: Checkout code
Expand Down
Loading
Loading