Forum

Please or Register to create posts and topics.

Opening database in SQLite causes damage??

Page 1 of 2Next

I was told by RootsMagic tech support yesterday that "even just opening the database in SQLite could have messed with the tables". Not running a query, just opening the database to look at the tables. Is that a true statement?

It's poppycock and reflects that the support person knows nothing more about SQLite than its name. What was their name?

If you run a write query or run the REINDEX command, you should subsequently on returning to RM run its Rebuild Indexes tool because RM's Check Integrity will show errors. That's because of the RMNOCASE collation sequence which controls sorting and matching on name fields. The RootsMagician has never released it so we have to fake it. Consequently, an index updated by outboard SQLite may have a discrepancy from the way it would be ordered by RM's SQLite.

Support may be alarmed at the increasing number of users posting about SQLite in recent months. I have yet to hear of  anyone submitting a problem to them caused by the misapplication of SQLite. On the other hand, I've solved problems for people that Support failed on because it needed in depth knowledge of the database structure and tools not resident in the RM user interface.

kevync has reacted to this post.
kevync

It was Renee Zamora, and I thought it was nonsense, but I wanted to check with the experts. I've had an ongoing problem with RM10 drag and drop that she swears up and down is caused by a corrupted database, although on my end it passes the integrity check every time and I run all the database tools frequently. I don't know that I've ever actually run an SQLite query on the db in question, just looked at the tables to see if one might be useful with the problem I was running into.

  1. What is the problem?
  2. Have you submitted your database to RM Support for them to experience the problem?
  3. Would you be willing to share your database with someone here to witness and investigate?
  4. Does a GEDCOM export-import to a new database eliminate the problem (export might fail under some conditions)

Drag'n'drop was formerly a GEDCOM process but is now more direct, from database to database without GEDCOM as an intermediary. We do not know how much is handled directly through SQLite queries and how much goes through intermediary processes the developers have written in Delphi.

 

  1. I originally posted about this in the RM community forum in November and here's a link to that post: https://community.rootsmagic.com/t/rm10-issue-with-copying/12416. I'm including it here because there's a screenshot that might be helpful.
  2. Renee advised opening a support ticket, which I did, and here's the description I gave at that time:

The database named “farr project 21Oct2024” was created via GEDCOM download from Ancestry. The FAMILY_4Nov2024 database is my main database that I’ve been using for years, beginning with The Master Genealogist and through several versions of RootsMagic. I’m currently running RM10.0.2.0 and macOS Sonoma on a Mac with the Apple M1 chip, although before the Mac version of RM was available I used the Windows versions with Parallels.

In order to keep track of what I’m doing and minimize needs for later merging and cleanup, I’m copying people over from the Farr Project DB to the Family DB in family groups whose size varies based on the amount of data in the two DBs. For example, in the Farr Project DB, I had a great deal of information on the descendants of Perry Green Anderson and Nancy Farr, but relatively little in the Family DB, so I decided to copy all of their descendants at once.

I had both DBs open to the Family view, with Nancy Farr highlighted. I dragged and dropped Nancy from the Farr Project DB to the FAMILY DB. I selected the “Descendants and their spouses” option and increased the number of generations to 15 just to make sure I got everyone. I checked the box at the bottom to indicate that yes, this is the same Nancy Farr and should be merged. The resulting screen showed 1387 people copied.

I then use the Merge Duplicates tool to find and merge most of the duplicates. This time, I haven’t merged any of the individuals listed below. And as with every time I’ve done this, the drag and drop process assigns an extra set of parents to Rayburn Alton Rogers (RIN 36880 & RIN 43880) and it’s the same two people: Pearl G. Yelton (RIN 24280) and Doris Allene Yelton (24281) Pearl and Doris are also assigned as extra parents to Rayburn’s sister, Beatrice Rogers (RIN 36878 and RIN 43872). Extra parents are also assigned to Aloe Phillips (RIN 36846 & RIN 43510): Thetus Brooks (RIN 2450) and Wayne Lee McMillan (RIN 24229). Extra parents are also assigned to Ronnie Howard Rogers (RIN 15488 & RIN 44536): Reuben Stockton (RIN 6122) and Nelson McKelsey (RIN 6123).

There may be others; these are just the ones that showed up on the merge duplicates screen.

3. Yes, absolutely, although it's two databases. However, both of the backup files are way over the attachment limit here. How do I send them in?

4. I haven't tried that.

Moved comment to a new post..

Quote from CherylC on 2025-01-22, 5:27 pm

3. Yes, absolutely, although it's two databases. However, both of the backup files are way over the attachment limit here. How do I send them in?

Dropbox, et al? I pm'd you in the Community site.

Tom

Thank you, Tom. I sent you a Dropbox link.

I've concluded that the RM 10.0.3 drag'n'drop has a bug and reported it in the thread @cherylc originated last November in the RootsMagic Community. It has to do with creating an erroneous entry in the ChildTable for the spouse of a descendant of the focus person in drag'n'drop when none should have been.

More investigation is needed to see how consistently this happens and whether there are other conditions giving rise to drag'n'drop corruption.

kevync has reacted to this post.
kevync

Tom, thank you so much! Renee kept insisting both databases were too corrupted for her to do anything with and I had just about given up hope of  getting an answer that made any sense to me.

Page 1 of 2Next