Manticore Github Issue Search Demo

Demo by Manticore Search GitHub

👀 While it's loading, feel free to check out the other repositories:

🔔 To get a notification when it's ready, leave your email here:

By entering your email, you agree to receive notifications and marketing-related emails

Filter by reset

Search in

State

Advanced

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

We may want to hide api_key in show create table output for security reasons.

sanikolaev · 2024-10-17

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

Dev call of Oct 28: ALTER should be supported for api_key

sanikolaev · 2024-10-28

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

Adding new options is easy. However, it is not clear what should be done with these options

glookka glookka · 2024-10-31

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

@donhardman pls advise.

sanikolaev · 2024-11-01

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

We should parse it and store it somewhere to make it possible for the indexer stage to use it to generate embeddings with the lib as discussed before on call.

donhardman · 2024-11-04

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

Here are points to consider: We should create a model and store pointers linked to model_name . This means we need a map of pointers to use in the future when indexing, where the key in this map is model_name . Reference examples can be found in: Test …

donhardman · 2024-11-05

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

Correct me if I'm wrong: Code that results in manticoresearch_text_embeddings.dll / manticoresearch_text_embeddings.so (after cargo build --lib --release ) is built externally by the CI and distributed with MCL Our MCL/KNN library only loads that .SO/.DLL …

glookka glookka · 2024-11-08

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

Correct me if I'm wrong: Discussed on today's dev call.

sanikolaev · 2024-11-11

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

fields = "field1, field2": fields we should use as the source for text to generate embeddings As discussed, it makes sense to use from instead of fields to make it less confusing and support not only ft-fields, but: string attrs stored only text

sanikolaev · 2024-11-21

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

How the embeddings library is used: On first insert daemon tells the knn library (from MCL) to create a model using a separate embeddings library MCL tries to load that library using the path from LIB_MANTICORE_KNN_EMBEDDINGS env var (if present) or from …

glookka glookka · 2024-11-21

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

As discussed on today's call, here's what's left to do within this task: Load the lib on daemon start There should be one more function in the lib for versioning which returns smth like 1.2.3 <date> <commit> . @donhardman pls address this Prepare for …

sanikolaev · 2024-11-25

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

There should be one more function in the lib for versioning which returns smth like 1.2.3 . @donhardman pls address this Here's a separate task for this https://github.com/manticoresoftware/manticoresearch-text-embeddings/issues/8

sanikolaev · 2024-11-25

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

Need to take a look and review two pull requests: https://github.com/manticoresoftware/manticoresearch-text-embeddings/pull/9 https://github.com/manticoresoftware/manticoresearch-text-embeddings/pull/11 I have changed the interface in the second one and …

donhardman · 2024-11-29

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

I implemented support for embeddings library in MCL and daemon (branches embeddings and embeddings_generation respectively). The next step is to integrate https://github.com/manticoresoftware/manticoresearch-text-embeddings/ into MCL and CI

glookka glookka · 2024-12-05

Integration with embedding library

donhardman · 2024-12-05 · 15 · #71

est::size_M

glookka glookka · 2024-12-05

Changes in CI needed for Jieba test

sanikolaev · 2024-09-29 · 4 · #70

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us …

CLAassistant · 2024-09-28

Changes in CI needed for Jieba test

sanikolaev · 2024-09-29 · 4 · #70

Linux debug test results 8 files 8 suites 7m 23s :stopwatch: 466 tests 450 :white_check_mark: 14 :zzz: 2 :x: 480 runs 464 :white_check_mark: 14 :zzz: 2 :x: For more details on these failures, see this check. Results for commit 7218a68d. :recycle: …

github-actions[bot] · 2024-09-28

Changes in CI needed for Jieba test

sanikolaev · 2024-09-29 · 4 · #70

Linux release test results 8 files 8 suites 6m 5s :stopwatch: 466 tests 450 :white_check_mark: 14 :zzz: 2 :x: 480 runs 464 :white_check_mark: 14 :zzz: 2 :x: For more details on these failures, see this check. Results for commit 7218a68d. :recycle: …

github-actions[bot] · 2024-09-28

Changes in CI needed for Jieba test

sanikolaev · 2024-09-29 · 4 · #70

Windows test results 5 files 5 suites 10m 45s :stopwatch: 449 tests 432 :white_check_mark: 14 :zzz: 3 :x: 457 runs 440 :white_check_mark: 14 :zzz: 3 :x: For more details on these failures, see this check. Results for commit 7218a68d. :recycle: …

github-actions[bot] · 2024-09-28

KNN Find-similar-docs-by-id doesn't work as described.

pavelnemirovsky · 2024-08-13 · 2 · #69

waiting

Are you sure that you runs with EXTRA=1? Cause everything works fine for me docker run -e EXTRA=1 --name manticore --rm -d manticoresearch/manticore:6.3.6 && echo "Waiting for Manticore docker to start. Consider mapping the data_dir to make it start …

djklim87 · 2024-08-13