Skip to content

DatasetGenerator - classes of reconciliation tests#73

Open
arorashu wants to merge 9 commits into
masterfrom
more-recon-tests
Open

DatasetGenerator - classes of reconciliation tests#73
arorashu wants to merge 9 commits into
masterfrom
more-recon-tests

Conversation

@arorashu

@arorashu arorashu commented Jul 27, 2020

Copy link
Copy Markdown
Collaborator

Addresses Issue#62

Create DatasetGenerator class to create different standard types of datasets.
Accepts isMultiset and isLargeSync as boolean flags to generate these specific datasets as well.

@arorashu

Copy link
Copy Markdown
Collaborator Author

The failing tests for CPISync are probably due to Issue#74. I will need to take a look why the CuckooSyncTest fails.

@arorashu
arorashu requested a review from novakboskov July 28, 2020 00:08
@arorashu arorashu changed the title More recon tests DatasetGenerator - classes of reconciliation tests Jul 28, 2020
@novakboskov

novakboskov commented Jul 28, 2020

Copy link
Copy Markdown
Collaborator

What I see in the CI build report is very weird. For example, it says that CuckooSyncTest.cpp:61:Assertion fails and that assertion is still commented out in your code, should not be executed at all (you seem not to pull from master recently, see #71).

Could you please merge master to your branch and make sure why these tests fail?

@novakboskov

novakboskov commented Jul 28, 2020

Copy link
Copy Markdown
Collaborator

Additionally, consider supporting the very basic test set generation function that would just simply return two std::multiset<shared_ptr<DataObject>>, as DataObject is our primary abstraction for the set elements. Set A and the set B, just to keep it simple.

@arorashu

Copy link
Copy Markdown
Collaborator Author

What I see in the CI build report is very weird. For example, it says that CuckooSyncTest.cpp:61:Assertion fails and that assertion is still commented out in your code, should not be executed at all (you seem not to pull from master recently, see #71).

So this is because Github merges the two branches itself, and runs the CI on the merge. I validated it from the CI output.

Could you please merge master to your branch and make sure why these tests fail?

Yeah, in effect the test failures are resultant of merging with master

@novakboskov

Copy link
Copy Markdown
Collaborator

@arorashu I see... Can you please look a bit closer into that to find the root cause of those failures?

@arorashu

arorashu commented Jul 28, 2020

Copy link
Copy Markdown
Collaborator Author

@novakboskov Yeah, added some relevant info at Issue#75

@arorashu

arorashu commented Jul 29, 2020

Copy link
Copy Markdown
Collaborator Author

So, CPISync fails for the case where server is empty. I have currently narrowed it down to the CPISync::set_reconcile function. For the case where server is empty, it does not populate the delta_self and delta_other entries. I will update when I have fixed that.

@arorashu

Copy link
Copy Markdown
Collaborator Author

Increasing Cuckoo filter size from 2^8 to 2^17, gives better sync performance at the expense of running time

@arorashu arorashu linked an issue Aug 3, 2020 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The classes of reconciliation tests

2 participants