Author Commit Message Commit Date David Young ea6dd16fbb8 Describe the behavior of H5FD_vfd_swmr_dedup() in excruciating detail. 25 Aug 2020 David Young 9ee6be22b99 Clarify my descriptions of H5FD_dedup() and H5FD_deduplicate(). 25 Aug 2020 David Young e1419c872e2 Do not use first person singular in the SWMR demos section.
In the `vfd_swmr_create_fapl()` dissection, change the /** **/
comments in the literal code to plain markdown paragraphs.
Slightly change wording and markdown elsewhere. 25 Aug 2020 David Young da4c72a138f Incorporate Mike's changes, fix some of my punctuation and markdown. 25 Aug 2020 David Young c492036b0d5 Add the VFD SWMR User's Guide, a work in progress. 25 Aug 2020 David Young 9326c3068cb M Merge branch 'feature/vfd_swmr' into single 21 Aug 2020 David Young 7af1fa67d6d When the superblock status flags don't meet our expectations, print
the flags and the expectations. 21 Aug 2020 David Young 482ee0765d5 Apply Dana's fix for production mode builds. 21 Aug 2020 David Young 2c3a3ebd7ca M Merge branch 'feature/vfd_swmr' into single 21 Aug 2020 David Young c68700769fa Avoid potential shadow-file clashes, call the shadow file `group-shadow`. 21 Aug 2020 David Young d0f1d9ab7b7 Call the shadow files bigset-shadow-<number> for some <number>,
to avoid unlikely shadow-file clashes. 21 Aug 2020 David Young fe4b7110a7b Avoid potential shadow-file clashes, call the file `generator-shadow`. 21 Aug 2020 David Young 88342f8b3f8 Use the safe calloc() idiom, p = calloc(1, sizeof(*p)), and do
not gratuitously cast to p's type. 21 Aug 2020 David Young 2fe7d17a766 Avoid potential shadow-file clashes, call the shadow file `rw-shadow`. 21 Aug 2020 David Young 2f30671e847 Straggler from last: call the shadow file `vlstr-shadow`. 21 Aug 2020 David Young 24e6e55c567 Avoid shadow file clashes, call the file `vlstr-shadow`. 21 Aug 2020 David Young 0c741c59975 To avoid potential clashes with other tests, call the shadow file `zoo-shadow`. 21 Aug 2020 David Young bcf91a09df8 Derive the name of the shadow file from the HDF5 file: drop the .h5, add
.shadow. 21 Aug 2020 David Young 7c26f6da6ee M Merge branch 'feature/vfd_swmr' into single 20 Aug 2020 David Young cd9c80925e1 Delete disused routine H5FD_has_conflict(). 20 Aug 2020 David Young ad3ff993c01 M Merge branch 'feature/vfd_swmr' into single 18 Aug 2020 David Young 38310e91760 Sleep 1/10s between H5Dopen() tries. Make a couple of warning/error messages
more clear/correct. 18 Aug 2020 David Young e33773db76d M Merge branch 'feature/vfd_swmr' into single 18 Aug 2020 David Young a06d6f235d5 Perform the dataset opens in reverse order to their creation, and if
H5Dopen fails, rapidly retry up to 9,999 times. Log H5Dopen failures,
but log no more than once every five seconds to avoid spamming the
terminal.
With these changes, it's easier for the reader to open the last dataset
before the writer created it, but the reader recovers instead of
quitting with an error. It should only be necessary to retry opening
the *last* dataset; all previous datasets should open on one try if the
... 18 Aug 2020 David Young 738d95581fc M Merge branch 'feature/vfd_swmr' into single 17 Aug 2020 David Young 0619c3dfd8e Fix copy-and-paste error: do not copy the H5T_C_S1 type twice. 17 Aug 2020 David Young 3c344cb1b4d M Merge branch 'feature/vfd_swmr' into de-mpmde 05 Aug 2020 David Young 695bd92140e Fix a regression that crept in with the August merge: use the "swmr" VFD when
that's called for. 05 Aug 2020 David Young 31e6f9ed78c M Merge branch 'aug-merge-attempt/feature/vfd_swmr' into aug-merge-attempt/de-mpmde 04 Aug 2020 David Young dc97b9a1656 M Merge branch 'aug-develop' into aug-merge-attempt/feature/vfd_swmr 04 Aug 2020 David Young f28c92bb366 M Merge branch 'may-develop' into may-merge-head/feature/vfd_swmr 04 Aug 2020 David Young 099de1c613c M Merge branch 'feature/vfd_swmr' into de-mpmde 03 Aug 2020 David Young 316aa34bacb Make tests pass on both of my branches, like they ought to: in the tests that
call H5F__vfd_swmr_writer_md_test(), actually sleep for more than `max_lag`
ticks so that the deferred-frees queue is actually flushed before we force new
items onto the queue and count them.
In H5F__vfd_swmr_writer_md_test(), check that the number of deferred
shadow-space frees is *precisely* the number `nshadow_defrees`, since that
seems to be what the tests that call this routine intend. 03 Aug 2020 David Young 82db14e18d2 M Merge branch 'feature/vfd_swmr' into de-mpmde 03 Aug 2020 David Young 20a6b825972 In VFD SWMR, use `H5F_shared_t` instead of `H5F_t` wherever that is possible. 03 Aug 2020 David Young b9888cceff9 The second argument to H5MV__sect_shrink() has to be an actual H5F_t *, not
NULL, so pass an actual H5F_t *. Bug found by code inspection. 03 Aug 2020 David Young 6e48db2455d M Merge branch 'feature/vfd_swmr' into de-mpmde 31 Jul 2020 David Young d01bcf66674 Perform virtual dataset tests with multiple source files, too. 31 Jul 2020 David Young 6caa0c5ac5f Let us use virtual datasets with multiple source files that are open with VFD
SWMR mode: pass H5P_FILE_ACCESS_ANY_VFD so that the discrepancy between VFD
SWMR file-access properties and default file-access properties is ignored. 31 Jul 2020 David Young 7321d0e813e Improve code readability: extract common subexpressions into temporary
variables. 30 Jul 2020 David Young a8cbf2579d4 In test_reader_md_concur(), the child has to exit(3), not FAIL_STACK_ERROR, on
error. 30 Jul 2020 David Young bf004fcba8d Bug fixes: don't double-close a FAPL ID. Always close a file ID. 30 Jul 2020 David Young 92887cad1c2 Update an out-of-date comment. 30 Jul 2020 David Young b6b92aff091 Remove superfluous casts from `void *` to another pointer type prior to
assignment. Use a safer sizeof(array element) idiom. NFCI. 30 Jul 2020 David Young 2a64d2fe93a Change H5F_open to perform deduplication of open VFDs in a more flexible way,
using the new routine H5FDdeduplicate().
Simplify H5F_open() a bit, pushing some of the configuration checks into the
SMWR VFD. For example, check that page buffering is enabled in
H5FD_vfd_swmr_open() instead of in H5F_open(). Compare VFD SWMR configurations
in H5FD_vfd_swmr_dedup() instead of in H5F_open().
Clone the default file-access property list at a new file-access property list
ID, H5P_FILE_ACCESS_ANY_V... 30 Jul 2020 David Young b93aeb1ab27 M Merge branch 'feature/vfd_swmr' into de-mpmde 28 Jul 2020 David Young 5632094d5c7 Initialize `refresh` member. 28 Jul 2020 David Young bbf8ca8878d M Merge branch 'feature/vfd_swmr' into de-mpmde 28 Jul 2020 David Young d93bc843aa2 Promote more warnings to errors. 28 Jul 2020 David Young 07a5fa7607b M Merge branch 'feature/vfd_swmr' into de-mpmde 21 Jul 2020 ← Prev Next → require('plugin/commitgraph/network').applyCommits([{id: 'ea6dd16fbb8ab5a5c09d4b03c9a60512da2d0ba5', href: '/users/dyoung/repos/vchoi_fork/commits/ea6dd16fbb8ab5a5c09d4b03c9a60512da2d0ba5',parents: [{ id: '9ee6be22b99ee9a0e88385fb5929f666331306dd' }]},{id: '9ee6be22b99ee9a0e88385fb5929f666331306dd', href: '/users/dyoung/repos/vchoi_fork/commits/9ee6be22b99ee9a0e88385fb5929f666331306dd',parents: [{ id: 'e1419c872e27a4178e3e6eabf78f48544d7f03ca' }]},{id: 'e1419c872e27a4178e3e6eabf78f48544d7f03ca', href: '/users/dyoung/repos/vchoi_fork/commits/e1419c872e27a4178e3e6eabf78f48544d7f03ca',parents: [{ id: 'da4c72a138f0e418d3f72d6f095f5f40c92d9648' }]},{id: 'da4c72a138f0e418d3f72d6f095f5f40c92d9648', href: '/users/dyoung/repos/vchoi_fork/commits/da4c72a138f0e418d3f72d6f095f5f40c92d9648',parents: [{ id: 'c492036b0d5a6dbcd2389af48fec95c80098210e' }]},{id: 'c492036b0d5a6dbcd2389af48fec95c80098210e', href: '/users/dyoung/repos/vchoi_fork/commits/c492036b0d5a6dbcd2389af48fec95c80098210e',parents: [{ id: '7af1fa67d6d2e441c72504ed9144576a797e1e3a' }]},{id: '9326c3068cb2eabd11dbfe96368e4a6d7c720ef9', href: '/users/dyoung/repos/vchoi_fork/commits/9326c3068cb2eabd11dbfe96368e4a6d7c720ef9',parents: [{ id: '2c3a3ebd7caf8f311a8b54e4aaea22aa1659e041' },{ id: '7af1fa67d6d2e441c72504ed9144576a797e1e3a' }]},{id: '7af1fa67d6d2e441c72504ed9144576a797e1e3a', href: '/users/dyoung/repos/vchoi_fork/commits/7af1fa67d6d2e441c72504ed9144576a797e1e3a',parents: [{ id: '482ee0765d53e65d0803e758b16e6ba33ea32af1' }]},{id: '482ee0765d53e65d0803e758b16e6ba33ea32af1', href: '/users/dyoung/repos/vchoi_fork/commits/482ee0765d53e65d0803e758b16e6ba33ea32af1',parents: [{ id: 'c68700769fa56b04e4e13f2e5019cc2b93599fd5' }]},{id: '2c3a3ebd7caf8f311a8b54e4aaea22aa1659e041', href: '/users/dyoung/repos/vchoi_fork/commits/2c3a3ebd7caf8f311a8b54e4aaea22aa1659e041',parents: [{ id: '7c26f6da6ee0e85352b0ec56eeaf1d76e3ae2e94' },{ id: 'c68700769fa56b04e4e13f2e5019cc2b93599fd5' }]},{id: 'c68700769fa56b04e4e13f2e5019cc2b93599fd5', href: '/users/dyoung/repos/vchoi_fork/commits/c68700769fa56b04e4e13f2e5019cc2b93599fd5',parents: [{ id: 'd0f1d9ab7b7bc429429e106cba9d98d716ac3eb5' }]},{id: 'd0f1d9ab7b7bc429429e106cba9d98d716ac3eb5', href: '/users/dyoung/repos/vchoi_fork/commits/d0f1d9ab7b7bc429429e106cba9d98d716ac3eb5',parents: [{ id: 'fe4b7110a7b03dfd398b72850600dc9607afb502' }]},{id: 'fe4b7110a7b03dfd398b72850600dc9607afb502', href: '/users/dyoung/repos/vchoi_fork/commits/fe4b7110a7b03dfd398b72850600dc9607afb502',parents: [{ id: '88342f8b3f8658bf82ce5d25d5597f237f23c544' }]},{id: '88342f8b3f8658bf82ce5d25d5597f237f23c544', href: '/users/dyoung/repos/vchoi_fork/commits/88342f8b3f8658bf82ce5d25d5597f237f23c544',parents: [{ id: '2fe7d17a766faab80edb4f0e094f2dc3f8210d01' }]},{id: '2fe7d17a766faab80edb4f0e094f2dc3f8210d01', href: '/users/dyoung/repos/vchoi_fork/commits/2fe7d17a766faab80edb4f0e094f2dc3f8210d01',parents: [{ id: '2f30671e8472d4d452b9bfb0d1670664288c660d' }]},{id: '2f30671e8472d4d452b9bfb0d1670664288c660d', href: '/users/dyoung/repos/vchoi_fork/commits/2f30671e8472d4d452b9bfb0d1670664288c660d',parents: [{ id: '24e6e55c5672aecf02b780574e23af5b665a909f' }]},{id: '24e6e55c5672aecf02b780574e23af5b665a909f', href: '/users/dyoung/repos/vchoi_fork/commits/24e6e55c5672aecf02b780574e23af5b665a909f',parents: [{ id: '0c741c59975cf9f598564e793df92fdbbadea0b9' }]},{id: '0c741c59975cf9f598564e793df92fdbbadea0b9', href: '/users/dyoung/repos/vchoi_fork/commits/0c741c59975cf9f598564e793df92fdbbadea0b9',parents: [{ id: 'bcf91a09df826ec3e01ade807a3e9bff70c30703' }]},{id: 'bcf91a09df826ec3e01ade807a3e9bff70c30703', href: '/users/dyoung/repos/vchoi_fork/commits/bcf91a09df826ec3e01ade807a3e9bff70c30703',parents: [{ id: 'cd9c80925e1612cf7a4c996fef99dc8632b8b520' }]},{id: '7c26f6da6ee0e85352b0ec56eeaf1d76e3ae2e94', href: '/users/dyoung/repos/vchoi_fork/commits/7c26f6da6ee0e85352b0ec56eeaf1d76e3ae2e94',parents: [{ id: 'ad3ff993c01643d86f55e3387c184d8521c05aa6' },{ id: 'cd9c80925e1612cf7a4c996fef99dc8632b8b520' }]},{id: 'cd9c80925e1612cf7a4c996fef99dc8632b8b520', href: '/users/dyoung/repos/vchoi_fork/commits/cd9c80925e1612cf7a4c996fef99dc8632b8b520',parents: [{ id: '38310e91760795632252aecddc294139fc00c449' }]},{id: 'ad3ff993c01643d86f55e3387c184d8521c05aa6', href: '/users/dyoung/repos/vchoi_fork/commits/ad3ff993c01643d86f55e3387c184d8521c05aa6',parents: [{ id: 'e33773db76d798c5cd0a7fbdfd63c6fa4c951b87' },{ id: '38310e91760795632252aecddc294139fc00c449' }]},{id: '38310e91760795632252aecddc294139fc00c449', href: '/users/dyoung/repos/vchoi_fork/commits/38310e91760795632252aecddc294139fc00c449',parents: [{ id: 'a06d6f235d5ec0956e8418f0fd5e9fe7cff0c47b' }]},{id: 'e33773db76d798c5cd0a7fbdfd63c6fa4c951b87', href: '/users/dyoung/repos/vchoi_fork/commits/e33773db76d798c5cd0a7fbdfd63c6fa4c951b87',parents: [{ id: '738d95581fc6f2d28b349f73335ef6e1c41633ea' },{ id: 'a06d6f235d5ec0956e8418f0fd5e9fe7cff0c47b' }]},{id: 'a06d6f235d5ec0956e8418f0fd5e9fe7cff0c47b', href: '/users/dyoung/repos/vchoi_fork/commits/a06d6f235d5ec0956e8418f0fd5e9fe7cff0c47b',parents: [{ id: '0619c3dfd8e00613a39ccbbe47ff3abeed0534e6' }]},{id: '738d95581fc6f2d28b349f73335ef6e1c41633ea', href: '/users/dyoung/repos/vchoi_fork/commits/738d95581fc6f2d28b349f73335ef6e1c41633ea',parents: [{ id: '3c344cb1b4df4fff5df225a13d453529e43a8509' },{ id: '0619c3dfd8e00613a39ccbbe47ff3abeed0534e6' }]},{id: '0619c3dfd8e00613a39ccbbe47ff3abeed0534e6', href: '/users/dyoung/repos/vchoi_fork/commits/0619c3dfd8e00613a39ccbbe47ff3abeed0534e6',parents: [{ id: '695bd92140e2dab142575b531a2c93693b425f47' }]},{id: '3c344cb1b4df4fff5df225a13d453529e43a8509', href: '/users/dyoung/repos/vchoi_fork/commits/3c344cb1b4df4fff5df225a13d453529e43a8509',labels: [{name: 'de-mpmde', type: 'BRANCH', href: '/users/dyoung/repos/vchoi_fork/browse?at=de-mpmde'}],parents: [{ id: '31e6f9ed78cc5d35353b8a723e5896705d30bd9a' },{ id: '695bd92140e2dab142575b531a2c93693b425f47' }]},{id: '695bd92140e2dab142575b531a2c93693b425f47', href: '/users/dyoung/repos/vchoi_fork/commits/695bd92140e2dab142575b531a2c93693b425f47',parents: [{ id: 'dc97b9a16569e588dd6c112153b3136003b14ee1' }]},{id: '31e6f9ed78cc5d35353b8a723e5896705d30bd9a', href: '/users/dyoung/repos/vchoi_fork/commits/31e6f9ed78cc5d35353b8a723e5896705d30bd9a',labels: [{name: 'aug-merge-attempt\/de-mpmde', type: 'BRANCH', href: '/users/dyoung/repos/vchoi_fork/browse?at=aug-merge-attempt\/de-mpmde'}],parents: [{ id: '099de1c613c1f068eca3f5930f4ea48ad5672f95' },{ id: 'dc97b9a16569e588dd6c112153b3136003b14ee1' }]},{id: 'dc97b9a16569e588dd6c112153b3136003b14ee1', href: '/users/dyoung/repos/vchoi_fork/commits/dc97b9a16569e588dd6c112153b3136003b14ee1',labels: [{name: 'aug-merge-attempt\/feature\/vfd_swmr', type: 'BRANCH', href: '/users/dyoung/repos/vchoi_fork/browse?at=aug-merge-attempt\/feature\/vfd_swmr'}],parents: [{ id: 'f28c92bb3661f43e9e05a15b78f748eb106adc18' },{ id: '33c0016eb63a1d7894bd708cd020ba091a9a9857' }]},{id: 'f28c92bb3661f43e9e05a15b78f748eb106adc18', href: '/users/dyoung/repos/vchoi_fork/commits/f28c92bb3661f43e9e05a15b78f748eb106adc18',parents: [{ id: '316aa34bacba01f84748eeaf011a3e2f2d4aac7a' },{ id: '26780517e6e55f8f3d049a148251b0811332e01f' }]},{id: '099de1c613c1f068eca3f5930f4ea48ad5672f95', href: '/users/dyoung/repos/vchoi_fork/commits/099de1c613c1f068eca3f5930f4ea48ad5672f95',parents: [{ id: '82db14e18d2f52fe75aa1f35eb10a8cbe2212a0e' },{ id: '316aa34bacba01f84748eeaf011a3e2f2d4aac7a' }]},{id: '316aa34bacba01f84748eeaf011a3e2f2d4aac7a', href: '/users/dyoung/repos/vchoi_fork/commits/316aa34bacba01f84748eeaf011a3e2f2d4aac7a',parents: [{ id: '20a6b825972ef359c33fcd2e79177b812696f14c' }]},{id: '82db14e18d2f52fe75aa1f35eb10a8cbe2212a0e', href: '/users/dyoung/repos/vchoi_fork/commits/82db14e18d2f52fe75aa1f35eb10a8cbe2212a0e',parents: [{ id: '6e48db2455d814ceb01e36756e896ec8aebe6989' },{ id: '20a6b825972ef359c33fcd2e79177b812696f14c' }]},{id: '20a6b825972ef359c33fcd2e79177b812696f14c', href: '/users/dyoung/repos/vchoi_fork/commits/20a6b825972ef359c33fcd2e79177b812696f14c',parents: [{ id: 'b9888cceff95787373555b1ecc6c2b7e114abcba' }]},{id: 'b9888cceff95787373555b1ecc6c2b7e114abcba', href: '/users/dyoung/repos/vchoi_fork/commits/b9888cceff95787373555b1ecc6c2b7e114abcba',parents: [{ id: 'd01bcf66674988dae9d7fd18b0e25014d812576a' }]},{id: '6e48db2455d814ceb01e36756e896ec8aebe6989', href: '/users/dyoung/repos/vchoi_fork/commits/6e48db2455d814ceb01e36756e896ec8aebe6989',parents: [{ id: 'b93aeb1ab277a838b0a29565e87517b1fb16345c' },{ id: 'd01bcf66674988dae9d7fd18b0e25014d812576a' }]},{id: 'd01bcf66674988dae9d7fd18b0e25014d812576a', href: '/users/dyoung/repos/vchoi_fork/commits/d01bcf66674988dae9d7fd18b0e25014d812576a',parents: [{ id: '6caa0c5ac5f998c30ed59e5b0722de39257aeb05' }]},{id: '6caa0c5ac5f998c30ed59e5b0722de39257aeb05', href: '/users/dyoung/repos/vchoi_fork/commits/6caa0c5ac5f998c30ed59e5b0722de39257aeb05',parents: [{ id: '7321d0e813eb2371725ba3c5d207899ff759a0a1' }]},{id: '7321d0e813eb2371725ba3c5d207899ff759a0a1', href: '/users/dyoung/repos/vchoi_fork/commits/7321d0e813eb2371725ba3c5d207899ff759a0a1',parents: [{ id: 'a8cbf2579d4572d7f4785c74ac7d5dc631199a2f' }]},{id: 'a8cbf2579d4572d7f4785c74ac7d5dc631199a2f', href: '/users/dyoung/repos/vchoi_fork/commits/a8cbf2579d4572d7f4785c74ac7d5dc631199a2f',parents: [{ id: 'bf004fcba8d8d21713bf5c20246d71e46880170e' }]},{id: 'bf004fcba8d8d21713bf5c20246d71e46880170e', href: '/users/dyoung/repos/vchoi_fork/commits/bf004fcba8d8d21713bf5c20246d71e46880170e',parents: [{ id: '92887cad1c2feb7da903248a79d19be808d516ef' }]},{id: '92887cad1c2feb7da903248a79d19be808d516ef', href: '/users/dyoung/repos/vchoi_fork/commits/92887cad1c2feb7da903248a79d19be808d516ef',parents: [{ id: 'b6b92aff0915e40723ba1ca76941c2b7ba77bf96' }]},{id: 'b6b92aff0915e40723ba1ca76941c2b7ba77bf96', href: '/users/dyoung/repos/vchoi_fork/commits/b6b92aff0915e40723ba1ca76941c2b7ba77bf96',parents: [{ id: '2a64d2fe93a0ba1da27c77df8a9e3b76e3cd5ee9' }]},{id: '2a64d2fe93a0ba1da27c77df8a9e3b76e3cd5ee9', href: '/users/dyoung/repos/vchoi_fork/commits/2a64d2fe93a0ba1da27c77df8a9e3b76e3cd5ee9',parents: [{ id: '5632094d5c733af77003ecf4051a14f38645d993' }]},{id: 'b93aeb1ab277a838b0a29565e87517b1fb16345c', href: '/users/dyoung/repos/vchoi_fork/commits/b93aeb1ab277a838b0a29565e87517b1fb16345c',parents: [{ id: 'bbf8ca8878d397dd109fc8f77d18f65c5af3552e' },{ id: '5632094d5c733af77003ecf4051a14f38645d993' }]},{id: '5632094d5c733af77003ecf4051a14f38645d993', href: '/users/dyoung/repos/vchoi_fork/commits/5632094d5c733af77003ecf4051a14f38645d993',parents: [{ id: 'd93bc843aa22938c9ffc3f34f9fd2701ad4f4d99' }]},{id: 'bbf8ca8878d397dd109fc8f77d18f65c5af3552e', href: '/users/dyoung/repos/vchoi_fork/commits/bbf8ca8878d397dd109fc8f77d18f65c5af3552e',parents: [{ id: '07a5fa7607bd6f55f21ba99f4febe4770d54299b' },{ id: 'd93bc843aa22938c9ffc3f34f9fd2701ad4f4d99' }]},{id: 'd93bc843aa22938c9ffc3f34f9fd2701ad4f4d99', href: '/users/dyoung/repos/vchoi_fork/commits/d93bc843aa22938c9ffc3f34f9fd2701ad4f4d99',parents: [{ id: '04e775b127987821d8e1c3993221598f348e7226' }]},{id: '07a5fa7607bd6f55f21ba99f4febe4770d54299b', href: '/users/dyoung/repos/vchoi_fork/commits/07a5fa7607bd6f55f21ba99f4febe4770d54299b',parents: [{ id: '53fe088088b7b8752a59246a5ed4fb0f5c8f3e4a' },{ id: '04e775b127987821d8e1c3993221598f348e7226' }]}]);
