Manticore Github Issue Search Demo

Demo by Manticore Search GitHub

👀 While it's loading, feel free to check out the other repositories:

🔔 To get a notification when it's ready, leave your email here:

By entering your email, you agree to receive notifications and marketing-related emails

Filter by reset

Search in

State

Advanced

k=100K, but much less is returned

Bug Description: Take this file: snikolaev@dev2:~$ ls -lah /home/snikolaev/lisdocument1.sql.gz -rw-rw-r-- 1 snikolaev snikolaev 362M Dec 8 18:02 /home/snikolaev/lisdocument1.sql.gz Load 100K docs with embeddings to Manticore: snikolaev@dev2:/tmp$ time …

sanikolaev · 2024-12-09 · 0 · #73

bug

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

We may want to hide api_key in show create table output for security reasons.

sanikolaev · 2024-10-17

Integration with embedding library

Proposal: We should add parsing of the parameters to enable connection with the new library for automatic embeddings. Currently, I suggest starting with the following specification: fields = "field1, field2" : fields we should use as the source for text …

donhardman · 2025-01-21 · 16 · #71

est::size_M

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

Dev call of Oct 28: ALTER should be supported for api_key

sanikolaev · 2024-10-28

Changes in CI needed for Jieba test

sanikolaev · 2024-09-29 · 4 · #70

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

Adding new options is easy. However, it is not clear what should be done with these options

glookka glookka · 2024-10-31

Release 2.3.0

sanikolaev · 2024-05-22 · 3 · #63

publishpack

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

@donhardman pls advise.

sanikolaev · 2024-11-01

Columnar analyzers unable to process exclude filters properly

Bug Description: Currently, integer columnar analyzers have issues processing exclude filters, specifically when table encoding is used. This needs to be fixed. Manticore Search Version: 6.3.1 Operating System Version: Any Have you tried the latest …

glookka glookka · 2024-07-30 · 1 · #68

bugrel::upcoming

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

We should parse it and store it somewhere to make it possible for the indexer stage to use it to generate embeddings with the lib as discussed before on call.

donhardman · 2024-11-04

CI: a few fixes and improvements

sanikolaev · 2023-10-06 · 0 · #35

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

Here are points to consider: We should create a model and store pointers linked to model_name . This means we need a map of pointers to use in the future when indexing, where the key in this map is model_name . Reference examples can be found in: Test …

donhardman · 2024-11-05

partial results with SI on

If you run this https://github.com/sanikolaev/Eclipsium_manticore_crash/tree/ac07a3560416f81bf32eaa3d0bcdcff5c1b1490b ( git clone; docker compose up ) you'll see that Manticore finds significantly less results with SI on compared to when SI is off: mysql> …

sanikolaev · 2024-05-23 · 1 · #36

bugrel::6.3.0_or_2.3.0

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

Correct me if I'm wrong: Code that results in manticoresearch_text_embeddings.dll / manticoresearch_text_embeddings.so (after cargo build --lib --release ) is built externally by the CI and distributed with MCL Our MCL/KNN library only loads that .SO/.DLL …

glookka glookka · 2024-11-08

CI: embedings

donhardman · 2024-12-25 · 1 · #74

pack

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

Correct me if I'm wrong: Discussed on today's dev call.

sanikolaev · 2024-11-11

knn tests are skipped in nightly test runs

Bug Description: knn tests are skipped in nightly test runs: Start 277: col_275 -- knn index 9/56 Test #277: col_275 -- knn index ........................................................***Skipped 0.05 sec Start 278: col_276 -- knn search vs json queries …

glookka glookka · 2024-11-01 · 2 · #72

bug

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

fields = "field1, field2": fields we should use as the source for text to generate embeddings As discussed, it makes sense to use from instead of fields to make it less confusing and support not only ft-fields, but: string attrs stored only text

sanikolaev · 2024-11-21

Update bug_report.yml

sanikolaev · 2024-05-30 · 0 · #64

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

How the embeddings library is used: On first insert daemon tells the knn library (from MCL) to create a model using a separate embeddings library MCL tries to load that library using the path from LIB_MANTICORE_KNN_EMBEDDINGS env var (if present) or from …

glookka glookka · 2024-11-21

Implement Annoy knn search

For #44 To build, fork Annoy into manticoresoftware org along with this commit on top for file I/O.

mitrokosta · 2024-07-04 · 1 · #65

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

As discussed on today's call, here's what's left to do within this task: Load the lib on daemon start There should be one more function in the lib for versioning which returns smth like 1.2.3 <date> <commit> . @donhardman pls address this Prepare for …

sanikolaev · 2024-11-25

Test

manticoresearch · 2024-07-03 · 1 · #66

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

There should be one more function in the lib for versioning which returns smth like 1.2.3 . @donhardman pls address this Here's a separate task for this https://github.com/manticoresoftware/manticoresearch-text-embeddings/issues/8

sanikolaev · 2024-11-25

Implement Annoy knn search

For https://github.com/manticoresoftware/columnar/issues/44 To pass the CI, this PR needs to be merged https://github.com/manticoresoftware/annoy/pull/2

mitrokosta · 2024-07-05 · 2 · #67

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

Need to take a look and review two pull requests: https://github.com/manticoresoftware/manticoresearch-text-embeddings/pull/9 https://github.com/manticoresoftware/manticoresearch-text-embeddings/pull/11 I have changed the interface in the second one and …

donhardman · 2024-11-29

Update manticore_src.txt

sanikolaev · 2024-03-25 · 3 · #50

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

I implemented support for embeddings library in MCL and daemon (branches embeddings and embeddings_generation respectively). The next step is to integrate https://github.com/manticoresoftware/manticoresearch-text-embeddings/ into MCL and CI

glookka glookka · 2024-12-05

sanikolaev · 2024-01-15 · 3 · #46

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

@donhardman ^

glookka glookka · 2024-12-05

String comparison is not working

sanikolaev · 2024-03-25 · 1 · #51

bug

Integration with embedding library

donhardman · 2025-01-21 · 16 · #71

est::size_M

We should rewrite the code to work with the library as a static integration into KNN dynamic. Here are the artifacts: https://github.com/manticoresoftware/columnar/actions/runs/12488890381 I also modified CMake, it should build locally without problems, …

donhardman · 2024-12-25

latest tests failures

test 452 and 466 failed here

tomatolog · 2024-03-25 · 1 · #52

Add SSE code to columnar scan

githubmanticore · 2023-02-08 · 1 · #17

➤ Ilya Kuznetsov commented: Done in 207ab42b. Queries like SELECT count(*) FROM taxi WHERE trip_type=0; became 5% faster.

githubmanticore · 2023-01-18

crash on select when too many ft fields

If you run this script: #!/usr/bin/php <?php if (count($argv) < 5) die("Usage: ".__FILE__." <batch size> <concurrency> <docs> <number of fields>\n"); // This function waits for an idle mysql connection for the $query, runs it and exits function process($ …

sanikolaev · 2023-02-08 · 1 · #14

bug

CI: embedings

donhardman · 2024-12-25 · 1 · #74

pack

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.0 out of 2 committers have signed the CLA.:x: glookka:x: …

CLAassistant · 2024-12-11

int -> bigint ALTER

Implement int->bigint ALTER support.

sanikolaev · 2023-09-28 · 0 · #34

est::size_S

knn tests are skipped in nightly test runs

glookka glookka · 2024-11-01 · 2 · #72

bug

fixed tests 275 and 276 models at https://github.com/manticoresoftware/manticoresearch/commit/31e044b725127ceec7eb5278cd9ce2e5709e13dc - now these should not fail at night CI with the master head

tomatolog · 2024-10-31

lib_manticore_columnar wrong path

Hello Under Debian 10 After Compiling Manticore columnar lib install in /share/manticore/modules But manticore not found it Then I copy libs to /usr/share/manticore/modules/lib_manticore_columnar.so And everything worked Manticore 5.0.3 cff178311@220703 …

webigorkiev · 2023-02-13 · 2 · #15

knn tests are skipped in nightly test runs

glookka glookka · 2024-11-01 · 2 · #72

bug

@glookka is it clear from the output here https://github.com/manticoresoftware/columnar/actions/runs/11600797966/job/32302302075 why knn tests are skipped? Also, is it correct there's no lib_manticore_knn.dll here https://github.com/manticoresoftware/ …

sanikolaev · 2024-11-01