Sign inSign up

chillfish8/lnx

By chillfish8

ā€¢Updated almost 2 years ago

āš” Blazingly fast, šŸŒŸ Feature-rich searching.

Image
0

4.6K

chillfish8/lnx repository overview

Lust Logo

āœØ Feature Rich | āš” Insanely Fastā 

An ultra-fast, adaptable deployment of the tantivy search engine via REST.

ā šŸŒŸ Standing On The Shoulders of Giants

lnx is built to not re-invent the wheel, it stands on top of the tokio-rsā  work-stealing runtime, axumā  a lightweight abstraction over hyper-rsā  combined with the raw compute power of the tantivy search engineā .

Together this allows lnx to offer millisecond indexing on tens of thousands of document inserts at once (No more waiting around for things to get indexed!), Per index transactions and the ability to process searches like it's just another lookup on the hashtable šŸ˜²

ā āœØ Features

lnx although very new offers a wide range of features thanks to the ecosystem it stands on.

  • šŸ¤“ Complex Query Parser.
  • ā¤ļø Typo tolerant fuzzy queries.
  • šŸ”„ More-Like-This queries.
  • Order by fields.
  • Fast indexing.
  • Fast Searching.
  • Several Options for fine grain performance tuning.
  • Multiple storage backends available for testing and developing.
  • Permissions based authorization access tokens.
ā Performance

lnx can provide the ability to fine tune the system to your perticular use case. You can customise the async runtime threads. The concurrency thread pool, threads per reader and writer threads, all per index.

This gives you the ability to control in detail where your computing resources are going. Got a large dataset but lower amount of concurrent reads? Bump the reader threads in exchange for lower max concurrency.

This allows you to get some very nice results and tune your application to your needs:

As a more detailed insight:

ā MeiliSearch
 INFO  lnxcli > starting benchmark system
 INFO  benchmark > starting runtime with 12 threads
 INFO  benchmark::meilisearch > MeiliSearch took 18.188s to process submitted documents
 INFO  benchmark              > Service ready! Beginning benchmark.
 INFO  benchmark              >      Concurrency @ 150 clients
 INFO  benchmark              >      Searching @ 50 sentences
 INFO  benchmark              >      Mode @ Standard
 INFO  benchmark::sampler     > General benchmark results:
 INFO  benchmark::sampler     >      Total Requests Sent: 7500
 INFO  benchmark::sampler     >      Average Requests/sec: 296.65
 INFO  benchmark::sampler     >      Average Latency: 505.654336ms
 INFO  benchmark::sampler     >      Max Latency: 725.2446ms
 INFO  benchmark::sampler     >      Min Latency: 10.085ms
 INFO  lnxcli                 > commands complete!
ā lnx
 INFO  lnxcli > starting benchmark system
 INFO  benchmark > starting runtime with 12 threads
 INFO  benchmark::lnx > lnx took 785.402ms to process submitted documents
 INFO  benchmark      > Service ready! Beginning benchmark.
 INFO  benchmark      >      Concurrency @ 150 clients
 INFO  benchmark      >      Searching @ 50 sentences
 INFO  benchmark      >      Mode @ Standard
 INFO  benchmark::sampler > General benchmark results:
 INFO  benchmark::sampler >      Total Requests Sent: 7500
 INFO  benchmark::sampler >      Average Requests/sec: 914.84
 INFO  benchmark::sampler >      Average Latency: 163.962587ms
 INFO  benchmark::sampler >      Max Latency: 668.0729ms
 INFO  benchmark::sampler >      Min Latency: 2.5241ms
 INFO  lnxcli             > commands complete!

Tag summary

Content type

Image

Digest

sha256:267979db0ā€¦

Size

30.8 MB

Last updated

almost 4 years ago

docker pull chillfish8/lnx