Query Suggestion Options
Last word completion
Keyboard Layouts
 GitHub

👀 While it's loading, feel free to check out the other repositories:

🔔 To get a notification when it's ready, leave your email here:

By entering your email, you agree to receive notifications and marketing-related emails

Filter by reset
245 results 31 ms in manticoresoftware/columnar

CI: embedings

donhardmandonhardman · 2025-03-24 · 1 · #74

pack

Knn quantization

glookkaglookka · 2025-03-10 · 4 · #79

pack

 All committers have signed the CLA.

CLAassistantCLAassistant · 2025-03-01

ci: added lib_manticore_knn.dll to windows test's artifacts

sanikolaevsanikolaev · 2025-03-01 · 4 · #75

CI: embedings

donhardmandonhardman · 2025-03-24 · 1 · #74

pack

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: glookka: …

CLAassistantCLAassistant · 2024-12-11

fixing build issues

glookkaglookka · 2025-03-11 · 3 · #81

Knn quantization

glookkaglookka · 2025-03-10 · 4 · #79

pack

 Linux debug test results   8 files    8 suites   8m 38s ⏱️ 478 tests 463 ✅ 15 💤 0 ❌ 492 runs  477 ✅ 15 💤 0 ❌ Results for commit 49318f5e. :recycle: This comment has been updated with latest results.

github-actions[bot]github-actions[bot] · 2025-03-01

knn tests are skipped in nightly test runs

Bug Description: knn tests are skipped in nightly test runs: Start 277: col_275 -- knn index 9/56 Test #277: col_275 -- knn index ........................................................***Skipped 0.05 sec Start 278: col_276 -- knn search vs json queries …

glookkaglookka · 2024-11-01 · 2 · #72

bug

Knn quantization

glookkaglookka · 2025-03-10 · 4 · #79

pack

 Linux release test results   8 files    8 suites   5m 55s ⏱️ 478 tests 463 ✅ 15 💤 0 ❌ 492 runs  477 ✅ 15 💤 0 ❌ Results for commit 49318f5e. :recycle: This comment has been updated with latest results.

github-actions[bot]github-actions[bot] · 2025-03-01

Changes in CI needed for Jieba test

sanikolaevsanikolaev · 2025-01-22 · 4 · #70

Knn quantization

glookkaglookka · 2025-03-10 · 4 · #79

pack

 Windows test results   5 files    5 suites   13m 17s ⏱️ 461 tests 446 ✅ 15 💤 0 ❌ 469 runs  454 ✅ 15 💤 0 ❌ Results for commit 49318f5e. :recycle: This comment has been updated with latest results.

github-actions[bot]github-actions[bot] · 2025-03-02

Integration with embedding library

Proposal: We should add parsing of the parameters to enable connection with the new library for automatic embeddings. Currently, I suggest starting with the following specification: fields = "field1, field2" : fields we should use as the source for text …

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 We may want to hide api_key in show create table output for security reasons.

sanikolaevsanikolaev · 2024-10-17

Implement Annoy knn search

For https://github.com/manticoresoftware/columnar/issues/44 To pass the CI, this PR needs to be merged https://github.com/manticoresoftware/annoy/pull/2

mitrokostamitrokosta · 2024-07-05 · 2 · #67

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 Dev call of Oct 28: ALTER should be supported for api_key

sanikolaevsanikolaev · 2024-10-28

k=100K, but much less is returned

Bug Description: Take this file: snikolaev@dev2:~$ ls -lah /home/snikolaev/lisdocument1.sql.gz -rw-rw-r-- 1 snikolaev snikolaev 362M Dec 8 18:02 /home/snikolaev/lisdocument1.sql.gz Load 100K docs with embeddings to Manticore: snikolaev@dev2:/tmp$ time …

sanikolaevsanikolaev · 2025-01-28 · 0 · #73

bugest::size_S

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 Adding new options is easy. However, it is not clear what should be done with these options

glookkaglookka · 2024-10-31

int -> bigint ALTER

Implement int->bigint ALTER support.

sanikolaevsanikolaev · 2023-09-28 · 0 · #34

est::size_S

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 @donhardman pls advise.

sanikolaevsanikolaev · 2024-11-01

Release 2.3.0

sanikolaevsanikolaev · 2024-05-22 · 3 · #63

publishpack

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 We should parse it and store it somewhere to make it possible for the indexer stage to use it to generate embeddings with the lib as discussed before on call.

donhardmandonhardman · 2024-11-04

Try Annoy instead of HNSW

We recently added HNSW support for KNN to this library. Together with Manticore Search it works so - https://manual.manticoresearch.com/dev/Searching/KNN#K-nearest-neighbor-search It would be great to implement, test and bechmark https://github.com/ …

sanikolaevsanikolaev · 2023-11-23 · 0 · #44

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 Here are points to consider: We should create a model and store pointers linked to model_name . This means we need a map of pointers to use in the future when indexing, where the key in this map is model_name . Reference examples can be found in: Test …

donhardmandonhardman · 2024-11-05

Add lz4 compression to strings

Currently strings are stored basically uncompressed (only lengths are compressed) when table compression is not applicable. It makes sense to try to add LZ4 compression to such strings to save disk space (string hases used for grouping and filters are …

githubmanticoregithubmanticore · 2022-07-13 · 0 · #13

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 Correct me if I'm wrong: Code that results in manticoresearch_text_embeddings.dll / manticoresearch_text_embeddings.so (after cargo build --lib --release ) is built externally by the CI and distributed with MCL Our MCL/KNN library only loads that .SO/.DLL …

glookkaglookka · 2024-11-08

Improve filtering performance by using SIMD predication

When columnar storage processes a filter, there are two heavy stages - unpacking data and processing the filter. Filtering performance can be improved by replacing conditions like if ( ( i==(ACCESSOR_VALUES)m_tValue ) ^ (!EQ) ) with predication using _ …

githubmanticoregithubmanticore · 2023-08-02 · 1 · #26

est::size_M

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 Correct me if I'm wrong: Discussed on today's dev call.

sanikolaevsanikolaev · 2024-11-11

to_string(a) requires a to be in the select list

to_string(<bool>) works only if the <bool> is in the select list too, otherwise it returns an empty value: mysql> drop table if exists t; create table t(a bool) engine='columnar'; insert into t(id, a) values(1, 1); select to_string(a) from t; select a, to …

sanikolaevsanikolaev · 2023-04-05 · 0 · #21

bug

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 fields = "field1, field2": fields we should use as the source for text to generate embeddings As discussed, it makes sense to use from instead of fields to make it less confusing and support not only ft-fields, but: string attrs stored only text

sanikolaevsanikolaev · 2024-11-21

Crash!!! Handling signal 11 on import to table with multi64 field

Doing an import to a table which uses columnar Manticore crashes with message Crash!!! Handling signal 11 . (SIGSEGV) No further details in query log and it is not related to a specific document. The import always crashes after a few seconds however. I …

patrikhermanssonpatrikhermansson · 2023-03-16 · 4 · #18

bugwaiting

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 How the embeddings library is used: On first insert daemon tells the knn library (from MCL) to create a model using a separate embeddings library MCL tries to load that library using the path from LIB_MANTICORE_KNN_EMBEDDINGS env var (if present) or from …

glookkaglookka · 2024-11-21

Bigint leads to index corruption

I'm doing an import of a fairly large dataset into Manticore with columnar. The table has several number fields and when these are set as type integer the import finishes without a hitch. However, if i change these to bigint the import crashes after a few …

patrikhermanssonpatrikhermansson · 2023-03-29 · 9 · #19

bugwaiting

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 As discussed on today's call, here's what's left to do within this task: Load the lib on daemon start There should be one more function in the lib for versioning which returns smth like 1.2.3 <date> <commit> . @donhardman pls address this Prepare for …

sanikolaevsanikolaev · 2024-11-25

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 There should be one more function in the lib for versioning which returns smth like 1.2.3 . @donhardman pls address this Here's a separate task for this https://github.com/manticoresoftware/manticoresearch-text-embeddings/issues/8

sanikolaevsanikolaev · 2024-11-25

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 Need to take a look and review two pull requests: https://github.com/manticoresoftware/manticoresearch-text-embeddings/pull/9 https://github.com/manticoresoftware/manticoresearch-text-embeddings/pull/11 I have changed the interface in the second one and …

donhardmandonhardman · 2024-11-29

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 I implemented support for embeddings library in MCL and daemon (branches embeddings and embeddings_generation respectively). The next step is to integrate https://github.com/manticoresoftware/manticoresearch-text-embeddings/ into MCL and CI

glookkaglookka · 2024-12-05

Integration with embedding library

donhardmandonhardman · 2025-03-20 · 21 · #71

est::size_M

 @donhardman ^

glookkaglookka · 2024-12-05