Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support parallel index build for hash key #12

Draft
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

otegami
Copy link
Owner

@otegami otegami commented Mar 7, 2025

No description provided.

@otegami otegami force-pushed the support-parallel-index-build-for-hash-key branch from ad7ee6e to 1be2a4b Compare March 7, 2025 07:32
@otegami otegami force-pushed the support-parallel-index-build-for-hash-key branch from 1be2a4b to c941628 Compare March 7, 2025 08:59
@otegami otegami force-pushed the support-parallel-index-build-for-hash-key branch from c941628 to 9f677ed Compare March 10, 2025 01:18
@otegami
Copy link
Owner Author

otegami commented Mar 10, 2025

ここまでの対応時のログ

grntest test/command/suite/column_create/vector/source/offline/parallel_for_hash_key.test
offset: 0
  tests/sec |    tests |   passes | failures |   leaked |  omitted | !checked |
|>                                                                                                                                             | [  0%]
=======================================================================================================================================================
[ 0] .
  parallel_for_hash_key                                                                                                         0.3685s [leaked(20511)]
=======================================================================================================================================================
=======================================================================================================================================================
table_create Data TABLE_NO_KEY
[[0,0.0,0.0],true]
column_create Data value1 COLUMN_SCALAR Text
[[0,0.0,0.0],true]
table_create Terms TABLE_HASH_KEY ShortText   --default_tokenizer TokenNgram   --normalizers NormalizerNFKC
[[0,0.0,0.0],true]
column_create Terms data_values COLUMN_INDEX|WITH_POSITION   Data value1 --n_workers -1
[
  [
    [
      -10,
      0.0,
      0.0
    ],
    "system call error: Bad file descriptor: failed to get file offset"
  ],
  false
]
#|e| system call error: Bad file descriptor: failed to get file offset
index_column_diff Terms data_values
[
  [
    [
      -22,
      0.0,
      0.0
    ],
    "[index-column][diff] column doesn't exist: <Terms>: <data_values>"
  ]
]
#|e| [index-column][diff] column doesn't exist: <Terms>: <data_values>
=======================================================================================================================================================
  tests/sec |    tests |   passes | failures |   leaked |  omitted | !checked |
|----------------------------------------------------------------------------------------------------------------------------------------------| [100%]

  tests/sec |    tests |   passes | failures |   leaked |  omitted | !checked |
       2.67 |        1 |        0 |        0 |        1 |        0 |        0 |
0% passed in 0.3744s.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant