#162 ✓closed
Paul Jones

Handling large numbers of entries

Reported by Paul Jones | 2011-01-24 13:02:50 UTC | in 0.9.3

Currently, the HibernateVersionCorrelationStore retrieves ids from the indexer, and then sends them into the database via a series of constraints (one per id). There is a high likelihood that this is going to hit database limits, resulting in queries being rejected when there are lots of entities in the system.

To correct this, we're considering making the Lucene index the primary store for correlations. Correlations would no longer live in the database, and would be directly stored (and retrieved) from the index.

To progress this, the plan is:

  1. Create a performance benchmark test loading very large numbers of entities to confirm the failure scenario;
  2. Eliminate the HibernateVersionCorrelationStore, and make the LuceneIndexer implement the VersionCorrelationStore functionality directly;

Comments and changes to this ticket

Please Sign in or create a free account to add a new ticket.

With your very own profile, you can contribute to projects, track your activity, watch tickets, receive and update tickets through your email and much more.

New-ticket Create new ticket

Create your profile

Help contribute to this project by taking a few moments to create your personal profile. Create your profile ยป

A Real Time Differencing Tool.

Shared Ticket Bins

People watching this ticket

Referenced by

Pages