Manticore Github Issue Search Demo

Currently to update a distributed table in RT mode you have to do DROP TABLE / CREATE TABLE . Let's wrap it into ALTER TABLE ... . The syntax is to be specified and discussed.

sanikolaev · 2024-05-09 · 3 · #1771

est::size_Sbuddy_candidate

CREATE TABLE ... WITH REPLACE can be implemented in the future and used here to provide atomicity (estimate: ~ half a work day). Another challenge is to make it support replication, so the same alter is propagated to the other nodes OR make a protection …

sanikolaev · 2024-05-09 · 3 · #1771

est::size_Sbuddy_candidate

sanikolaev · 2024-02-01

Issues 1810 1866

#1810 #1866 Code changes are tested, however commits also includes docs which need to be proofread.

klirichek · 2024-05-09 · 1 · #2158

Properly rotate index if using only RT indexes (ALTER RENAME)

usatenko · 2024-05-09 · 16 · #527

est::size_Sest::size_Mbuddy_candidaterel::next

You are probably looking for smth like ALTER TABLE RENAME (in mysql and postgresql)? Unfortunately it's not supported yet. If you elaborate more on why it's important in your case we can consider this a feature request.

sanikolaev · 2021-04-09

WARNING: wordlist size mismatch (size=18, checkpoints=0)

Bug Description: It looks like we have wrong processing of an empty dictionary loading/writing CREATE TABLE x ( id bigint, tag bigint ); insert into x values (1,1),(2,2),(3,3); flush ramchunk x; insert into x values (4,1),(5,2),(6,3); flush ramchunk x; …

klirichek · 2024-05-09 · 1 · #2120

bugest::size_S

Issues 1810 1866

klirichek · 2024-05-09 · 1 · #2158

I've updated the docs. Some notes: I removed everything related to raw_response because it's not necessary for human users. It's needed exclusively to simplify the generation of our clients. Removing it helps keep the documentation simpler. I placed /cli …

sanikolaev · 2024-05-09

Properly rotate index if using only RT indexes (ALTER RENAME)

I am having trouble finding a proper way to rotate data in RT index. For the sake of speed, I am indexing data to RT index directly (sending concurrent queries and bulk inserts). But, when I need to reindex the data from the scratch I can't just prepare a …

usatenko · 2024-05-09 · 16 · #527

est::size_Sest::size_Mbuddy_candidaterel::next

I see the searchd does: [pid 1252352] openat(AT_FDCWD, "/var/lib/manticore/t2/t2.meta", O_RDONLY) = 2106 [pid 1252352] read(2106, "{\n\"meta_created_time_utc\":\"2024-"..., 635) = 635 [pid 1252352] close(2106) = 0 [pid 1252352] openat(AT_FDCWD, "wf", O_ …

djklim87 · 2024-05-09 · 3 · #2154

bugrel::upcoming

sanikolaev · 2024-05-09

buddy can not work at Windows if listen is 127.0.0.1

Bug Description: When listen = 127.0.0.1:9312 used on Windows buddy that starts in the docker can not communicate with daemon and daemon replies with error mysql -h 127.0.0.1 -P 9315 -vvv -e "show queries" ERROR 1064 (42000) at line 1: P01: syntax error, …

tomatolog · 2024-05-09 · 5 · #2118

bug

@Nick-S-2018 pls check what timezone ES uses when it's not provided, e.g.: 2019-03-23T21:34:46 You also wanted to add more examples with timezones.

Nick-S-2018 · 2024-05-09 · 11 · #1744

rel::upcomingest::size_M

sanikolaev · 2024-01-19

Moved Thai script to a separate charset

Type of Change (select one): Bug fix Description of the Change: moved Thai script to its own charset Related Issue (provide the link): https://github.com/manticoresoftware/manticoresearch/issues/2103

Nick-S-2018 · 2024-05-08 · 0 · #2149

Syntax is alter table `dist` local='t1' local='t3';

sanikolaev · 2024-05-09 · 3 · #1771

est::size_Sbuddy_candidate

djklim87 · 2024-05-09

Bug Description: Can't import table with wordforms echo "a > b" > /tmp/wf; mysql -h0 -P9306 -e "create table wftest(f text) wordforms='/tmp/wf'" mysql -h0 -P9306 -e "insert into wftest(id) values(1)" mysql -h0 -P9306 -e "import table t2 from '/var/lib/ …

djklim87 · 2024-05-09 · 3 · #2154

bugrel::upcoming

In such case, ES uses the UTC time without setting any default time zone. I've added the examples with string time zones to the format list above.

Nick-S-2018 · 2024-05-09 · 11 · #1744

rel::upcomingest::size_M

Nick-S-2018 · 2024-01-22

Update buddy version

Updating buddy version to 2.3.7-24050912-441025d

githubmanticore · 2024-05-09 · 2 · #2157

The issue is not new: root@a2ad520fb15e:/var/lib/manticore# searchd -v Manticore 6.2.12 dc5144d35@230822 root@a2ad520fb15e:/var/lib/manticore# echo "a > b" > /tmp/wf; root@a2ad520fb15e:/var/lib/manticore# mysql -h0 -P9306 -e "create table wftest(f text) …

djklim87 · 2024-05-09 · 3 · #2154

bugrel::upcoming

sanikolaev · 2024-05-09

added list of the date formats for timestamp fields

to test CI at all environments

tomatolog · 2024-05-09 · 0 · #2155

Properly rotate index if using only RT indexes (ALTER RENAME)

usatenko · 2024-05-09 · 16 · #527

est::size_Sest::size_Mbuddy_candidaterel::next

I don't remember the exact details now, But pretty sure have had success using 'ATTACH' to move data from one RT index to the other. Each 'shard' an RT index is effectively a 'plain' index. So just move each shard separately. (or can use OPTIMIZE to make …

barryhunter · 2021-04-09

1👍1

Integration with a newer Grafana mysql plugin

In https://github.com/manticoresoftware/manticoresearch/issues/1476 @reyjrar said: The MySQL plugin has been significantly upgraded since the blog post about Grafana integration and the Grafana Query builder no longer works with Manticore. This task is to …

sanikolaev · 2024-05-09 · 1 · #1842

The same case with the exceptions mysql> import table table3 from '/var/lib/manticore/table2/table2'; ERROR 1064 (42000): unable to import table 'table3': failed to prealloc: 'synonyms': failed to open exceptions.txt: No such file or directory

djklim87 · 2024-05-09 · 3 · #2154

bugrel::upcoming

PavelShilin89 · 2024-05-09

Native support for message queues

Is your feature request related to a problem? Please describe. Data ingestion into ManticoreSearch is not trivial as it may be. SQL and JSON interfaces is great, but require some code to be written, tested, and deployed. Native support for tools like …

AbstractiveNord · 2024-05-09 · 21 · #1500

1👍1

est::size_L

This issue blocks https://github.com/manticoresoftware/buddy-plugin-insert/issues/6

Nick-S-2018 · 2024-05-09 · 11 · #1744

rel::upcomingest::size_M

Nick-S-2018 · 2024-01-23

Problem with using >

In Clt-teste, it is not possible to use the > symbol instead of the => symbol when using exceptions and wordforms. MRE ––– input ––– echo "a > b" > /var/lib/manticore/wordforms1.txt; echo "c > d" > /var/lib/manticore/exc.txt; echo "abcstop" > /var/lib/ …

PavelShilin89 · 2024-05-09 · 1 · #2148

bugest::size_S

Waiting for approve https://github.com/manticoresoftware/buddy-core/pull/47/files

sanikolaev · 2024-05-09 · 3 · #1771

est::size_Sbuddy_candidate

djklim87 · 2024-05-09

Properly rotate index if using only RT indexes (ALTER RENAME)

Currently, Manticore cannot correctly detect a date passed as a string ( like 2019-03-23 ) and convert it to the corresponding timestamp. Instead, we just convert it to 0 or, if it starts with some digits, to those digits ( e.g., 2000-01-01 is converted …

Nick-S-2018 · 2024-05-09 · 11 · #1744

rel::upcomingest::size_M

usatenko · 2024-05-09 · 16 · #527

est::size_Sest::size_Mbuddy_candidaterel::next

ALTER TABLE RENAME is exactly what I am looking for. @sanikolaev well, a use case here is the same as the standard way of getting RT index: plain index indexation then attach to RT index, however, the limitation of this method is the speed of getting …

usatenko · 2021-04-19

Ubuntu Noble clt tests #manticoresoftware/manticoresearch/2091

Type of Change (select one): Bug fix New feature Documentation update Description of the Change: Related Issue (provide the link):

djklim87 · 2024-05-07 · 2 · #2147

Properly rotate index if using only RT indexes (ALTER RENAME)

usatenko · 2024-05-09 · 16 · #527

est::size_Sest::size_Mbuddy_candidaterel::next

@barryhunter as I remember I tried this attach option, however without FLUSHing, will try, many thanks.

usatenko · 2021-04-19

Add support for Ubuntu Noble 24.04

Proposal: Ubuntu Noble 24.04 is out. We need to add support for it: add new sysroots consider rebuilding dockers: testing docker building docker Manticore's official docker & test-kit add new dirs on repo.manticoresearch.com update repomanager's scripts …

sanikolaev · 2024-05-09 · 6 · #2091

rel::upcomingest::size_S

Update buddy version

githubmanticore · 2024-05-09 · 2 · #2157

…clt 👎 CLT tests in test/clt-tests/plugins/ ✅ OK: 0 ❌ Failed: 1 ⏳ Duration: 10s 👉 Check Action Results for commit 386f140 Failed tests: ––– input ––– rm -f /var/log/manticore/searchd.log; searchd --stopwait > /dev/null; searchd; if timeout 10 grep -qm1 '\[ …

github-actions[bot] · 2024-05-09

Complete integration with Kibana

Manticore can work with Kibana like this: # download manticore beta version with support for Kibana, check https://repo.manticoresearch.com/repository/kibana_beta/ for different OS versions wget https://repo.manticoresearch.com/repository/kibana_beta/ …

sanikolaev · 2024-05-09 · 29 · #832

1👍1

To think through: support timestamp64 and timestamp vs changing timestamp to always be bigint there's another related issue about storing datetime formats

Nick-S-2018 · 2024-05-09 · 11 · #1744

rel::upcomingest::size_M

sanikolaev · 2024-02-07

plain index needs autodetection of date formats for timestamp fields

Proposal: as the https://github.com/manticoresoftware/manticoresearch/issues/1744 added autoconversion of string into timestamp attribute on posting data into RT index the plain index data sources also need such conversion Checklist: To be completed by …

tomatolog · 2024-05-09 · 0 · #2156

Native support for message queues

AbstractiveNord · 2024-05-09 · 21 · #1500

1👍1

est::size_L

@tomatolog please make a research of this task to prepare a better specification and estimate.

sanikolaev · 2024-01-15

Possible issue with Buddy on Windows

Bug Description: We seem to have a peculiar issue while using Buddy on Windows. We should try to replicate it on another machine and validate if it's a localized issue or a more widespread problem. Due to the changes we've made in how we work with …

donhardman · 2024-05-09 · 6 · #2116

bug

Update buddy version

githubmanticore · 2024-05-09 · 2 · #2157

…clt 👎 CLT tests in test/clt-tests/core/ test/clt-tests/expected-errors/ ✅ OK: 7 ❌ Failed: 1 ⏳ Duration: 221s 👉 Check Action Results for commit 386f140 Failed tests: ––– input ––– rm -f /var/log/manticore/searchd.log; searchd --stopwait > /dev/null; …

github-actions[bot] · 2024-05-09

Change TIMESTAMP type from INT to BIGINT

Max timestamp we can store now is 2147483647, but we require to store greater timestamps. So, it would be better to change its type to BIGINT. Current limit is not logical at all.

glukkkk glukkkk · 2024-05-09 · 4 · #421

Native support for message queues

AbstractiveNord · 2024-05-09 · 21 · #1500

1👍1

est::size_L

nickchomey · 2024-01-15

Non exist chunk crash

Bug Description: create table abc; show table abc chunk 55 settings; In stdout Crash!!! Handling signal 11 addr2line: 'searchd': No such file Manticore Search Version: searchd -v Manticore 6.2.13 a26913aa0@24050810 dev (columnar 2.2.5 478fff2@240417) ( …

djklim87 · 2024-05-09 · 0 · #2153

bug