• kdb Insights

  KDB Insights Enterprise Error: "Querying database using (Q) raised – Connection reset"

  Posted by cperezln on November 6, 2023 at 12:00 am

  Good evening,

  I’ve been working on KDB Insights Enterprise to build a demo and I am having problems querying the data.

  Once I’ve built the pipeline and database schema (and consequently deployed it) I can query data for a while, but then I get a log fatal error (in the database, not in the pipeline). The mentioned log error is:

  { "time":"2023-11-06T11:13:03.892z", "component":"CONN", "level":"FATAL", "message":"[eod] Lost connection to eoi", "service":"eod", "container":"sm", "pod":"db-3g-sm-0" }

  And I am not sure how to fix it. Any suggestion? Why is this happening?

   

  Kind regards,

  Cristian

  cperezln replied 8 months, 3 weeks ago 2 Members · 2 Replies
• 2 Replies

• 

  gyorokpeter-kx

  Member

  November 6, 2023 at 12:00 am

  Can you check resource usage in your cluster? If you ingest too much data to fit into the memory of the EOI process, it will exit with a memory limit error (-w abort) and be unable to persist your data.

• 

  cperezln

  Member

  November 6, 2023 at 12:00 am

  I cannot, right now I am working remotly and I have no access to the cluster.

  I have two questions on that.

  • How much is “too much” data? I am sending by Kafka a 32 items dictionary each second, which after the pipeline will be appended as a new row to the table (with 32 columns).
  • Is there any way on increasing the memory from Insights Enterpise itself?

  Kind regards,

  Cristian

Log In to Reply