Filter by reset
- Everywhere
192 - Issues
50 - Pull Requests
43 - Comments
99
Improve CLT output with user command
We should improve our CLI action and provide users with a given command that they can run to validate the test locally. In the same output, we should dump information about the script and real command execution.
…"git operation failed": The button becomes invisible when I hover over it: Too much empty space here which makes the prompt's font too small: "your command or question" is confusing. It makes users wonder things like: "Is there a list of supported …
I've got this test /home/box/clt/ui/workdir/sanikolaev/test/clt-tests/core/search-stats-global-vs-table-consistency.rec on the server and I can't run it via UI. It says "Running test" and never returns any status. Here's what it looks like after running …
When an actual output changes after changing the command the expected output becomes empty:
Skip adding succeed tests to summary
We should add to summary only those tests that failed same we do in comments
Description: HTTP requests sent through Buddy without ; echo at the end cause the request to hang indefinitely, and the test does not complete. The query works correctly when executed via MySQL CLI (mysql -h0 -P9306 -e "show version;"). The issue occurs …
bug
CLT improvements and bug fixes
We should add some improvements to CLT and investigate bugs Currently we cannot see OK in outputs by default, looks like at some point in time it stopped working We should add possibility to disable single line matching as requested by @PavelShilin89
CLT UI fails to process %{NUMBER}
Let's add support for ---comment--- totally ignored by CLT when replaying the test. It will make it much easier to understand what the author means when testing something.
Bug: CLT crashes on test written with AI while it looks like correct
There is crash on test generated AI. We should investigate and fix it. Also, we should improve the MCP server to be error-prone, and in case of a crash or wrong exit codes, it should also return an error. Comprehensive test of all full-text search …
Make CLT to run from global PATH
Currently when we add path to CLT in PATH we are still unable to use it due to failed to find required files to run in specified path
Nightly CI Pipeline Timeout in test-migration-es-ms.rec (No .rep File for Debugging)
Description Nightly CI pipeline running the test-migration-es-ms.rec test in the Nightly tests of mysqldump and elasticdump job started to crash on April 9, 2025 due to execution time overrun (timeout after 5-6 hours). Normally the job would run for 8-9 …
bug
Issue with wrong rec generated in manual mode
We have issue with recording in manual mode as follows: ./clt record -t test.rec load ––– input ––– echo 1 > /dev/null ––– output ––– - clt> ––– input ––– sleep 1 ––– output –––
Refactor: Deprecate PTY and use fork
Currently, we use PTY to read low-level data and try to understand if commands have finished or not due to the original idea of supporting interactive mode. We are moving forward and probably will not need it. To make the tool simpler and more error-proof …
We should think about the easiest way to integrate what we researched into the UI that is still in the branch. We should add a CLI binary that will utilize our MCP server and will be able to produce tests with user prompts through the UI and also allow us …
Currently, we check the output of each command with strict matching and regular expressions, which means all output needs to match exactly for each command. The idea is to introduce custom checkers/validators that can be represented as linked aliases or …
To make things easier and try to make AI follow proper structure and better blend flow, there is an idea to develop an MCP server and adapt it with the flow to create tests from scratch.
Implementing a duration and the relative percentage for each command in a test seems like a great idea. We can use our existing block syntax and just overlook it during the test: ––– duration: 0.123ms (10.2%) –––
enhancement
We should look into all changes made and actualize readme to make it follow what we currently have.
Add default delay a few ms between inputs
Sometimes, when you replay a CLT test, one input may run too soon after the previous one. It is recommended to add a default delay between inputs, such as 5ms.