Author Commit Message Commit Date Quincey Koziol 0e8b8c63ca3 Move repo to https://github.com/hpc-io/vol-pnetcdf.git 08 Dec 2020 Huihuo Zheng 4e78c68804f changed dates 20 Aug 2019 Huihuo Zheng 19e88c765db added Huihuo 20 Aug 2019 Richard James Zamora fbaa517b8fa do update 3 19 Apr 2019 Richard James Zamora d25cfa22b51 second documentation update 19 Apr 2019 Richard James Zamora a996dd95d7e documentation progress 19 Apr 2019 Richard James Zamora 310b64cc155 cleanup and new documentation progress 18 Apr 2019 Richard James Zamora 860b391ff80 correcting submission script errors 17 Apr 2019 Richard James Zamora c3a99c727c7 still need to add option in H5VL_cdf_dataset_get to return the variable type, but code/test is otherwise working nicely on my Mac. There may be issues on Theta/etc, but we are in a good place for a decent documentation draft. 17 Apr 2019 Richard James Zamora e3651f1fc17 vol_test.c now allows the user to use double-precision arrays (using the --double flag). 17 Apr 2019 Richard James Zamora c90e21803e6 code now works with hyperslab selctions on record variables (multiple record variables are allowed - as are mix of record and non-record variables) 17 Apr 2019 Richard James Zamora 5906f1d3b2a now reading record variables correctly -- now only need to address cases with multiple record variables (stride between records). This may only require changes to the construction of the dimension-multiplier array (mm). The multiplier for the first dimension can just be set to the record stride distance. 16 Apr 2019 Richard James Zamora efcc0cb7530 added necessary file-view reset 16 Apr 2019 Richard James Zamora 1f476cfd8f3 woriking on record variable support with hyperslab selections -- may be able to adjust test to use correct process mapping, then just modify the dimension multiplyer used to calculate the position in source, etc.. 15 Apr 2019 Richard James Zamora 9ac30cae497 created the cdf_select_all_read helper funtion to avoid reusing code 14 Apr 2019 Richard James Zamora f30b3127b5c adding record-variable reading for ALL selections in hdf5 -- still need to add capability to hyperslab selection. Should also add optimized pathway for simple hyperslab mappings (current approach is more general than it needs to be in many cases). 14 Apr 2019 Richard James Zamora 7b65f3f811c can now write and read record variables with pnetcdf - just need to add read to cdfvl code. 12 Apr 2019 Richard James Zamora efb069e978f starting to add record-variable support 10 Apr 2019 Richard James Zamora 7d8f602e25c adding file-open timer back in to check scaling of header-parsing code 09 Apr 2019 Richard James Zamora 4ab24859061 adding additional loop to submission script 09 Apr 2019 Richard James Zamora 0c820a352d9 prepared for production tests on Theta 09 Apr 2019 Richard James Zamora 8dd200c4ac3 ready to add submission script for theta scaling 08 Apr 2019 Richard James Zamora bba5f325e12 refactored benchmark progress - working, but need to reorder vol read to time all variables together 08 Apr 2019 Richard James Zamora b72c0515038 refactor -- update 2 08 Apr 2019 Richard James Zamora bdf56beb8f4 refactor progress - update 1 08 Apr 2019 Richard James Zamora bcbfa5939b3 corrections after testing on Theta debug queue - fixing use of MPI_Dims_create etc. 04 Apr 2019 Richard James Zamora 8f8f537acd8 adding simple API for user to get file metadata (outside HDF5 API) -- This is just a stopgap functionality addition 02 Apr 2019 Richard James Zamora dc1bac7889f adding ability to open and read an attribute BY NAME ONLY. Still need to add functionality for user to inspect file (determine the attributes and variables in the file). 25 Mar 2019 Richard James Zamora 356b3d3e766 Cleanup of benchmark/test and VOL code. Next steps are to improve VOL API support and test performance on Theta. 25 Mar 2019 Richard James Zamora 29962b56163 hyperslab selection is improved (and allows for MPI and POSIX-based IO). Still need to clean up and add functionality to read attributes and query metadata. 25 Mar 2019 Richard James Zamora 7c4bbb29df6 Replaced hyperslab selection with code from the ADIOS VOL - The code should be more flexible now, but the assignToMemSpace call seems to be wrong - need to check if the benchmark is actually the part that is wrong (is the memory hyperslab selection correct?). 22 Mar 2019 Richard James Zamora 941d3e3387d very simple hyperslab selection is working for single blocks into a single contiguous buffer - complex mapping between selections is not supported. 19 Mar 2019 Richard James Zamora 925b25e6f06 progress toward hyperslab selection, etc 13 Mar 2019 Richard James Zamora dce9e2e3162 adding H5VL_cdf_dataset_get cakkback to allow user-app to get storagesize 13 Mar 2019 Richard James Zamora 728d2bb137a correcting strcmp test mistake 12 Mar 2019 Richard James Zamora dd347bb1637 simple H5S_SEL_ALL integer example working 12 Mar 2019 Richard James Zamora 3b78e38f70d working on H5S_SEL_ALL dataset read 11 Mar 2019 Richard James Zamora bcb593111ef Progress - Metadata is read through a cache that is read by rank 0 and then broadcasted to the other processes. The current version of the code should scale reasonably well (but the H5VL_CDF_CACHE_SIZE parameter will determine the performance). 11 Mar 2019 Richard James Zamora 9c5053c2b82 comment cleanup and ENABLE_CDF_VERBOSE addition for print statements 08 Mar 2019 Richard James Zamora 8e875447f06 CDF VOL will now parse typical file header correctly - Just need to clean up the implementation and tackle serial data access next (then parallel data access) 08 Mar 2019 Richard James Zamora ba87b943a84 saving further progress for parsing the CDF header. Currently working on the variable metadata 08 Mar 2019 Richard James Zamora 6cdddde8ac3 more progress for parsing header 07 Mar 2019 Richard James Zamora 3a086a342b6 adding functionality to read CDF header in CDF VOL 06 Mar 2019 Richard James Zamora 1c276275f11 adding pnetcdf code to test 05 Mar 2019 Richard James Zamora 1a7c425127f removing object files 05 Mar 2019 Richard James Zamora b99a5f4426d starting a simplistic CDF VOL 05 Mar 2019 Richard James Zamora f16463b847a initial commit of pnetcdf_vol - I am including an adios example as a template that I can play with 01 Mar 2019 require('plugin/commitgraph/network').applyCommits([{id: '0e8b8c63ca309fbc86b2ca0305888fcdd4b70510', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/0e8b8c63ca309fbc86b2ca0305888fcdd4b70510',labels: [{name: 'master', type: 'BRANCH', href: '/projects/HDF5VOL/repos/pnetcdf-vol/browse?at=master'}],parents: [{ id: '4e78c68804fe359ab05209879f269830e68391a4' }]},{id: '4e78c68804fe359ab05209879f269830e68391a4', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/4e78c68804fe359ab05209879f269830e68391a4',parents: [{ id: '19e88c765dbfdef2556e402560bf3762b74466ec' }]},{id: '19e88c765dbfdef2556e402560bf3762b74466ec', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/19e88c765dbfdef2556e402560bf3762b74466ec',parents: [{ id: 'fbaa517b8fa2b830b5edb18848b5c24d0aea9a11' }]},{id: 'fbaa517b8fa2b830b5edb18848b5c24d0aea9a11', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/fbaa517b8fa2b830b5edb18848b5c24d0aea9a11',parents: [{ id: 'd25cfa22b5145900af97fe8e793c1918ece8c11c' }]},{id: 'd25cfa22b5145900af97fe8e793c1918ece8c11c', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/d25cfa22b5145900af97fe8e793c1918ece8c11c',parents: [{ id: 'a996dd95d7ef6ee344a1e74a2aad6f2cd4c31a68' }]},{id: 'a996dd95d7ef6ee344a1e74a2aad6f2cd4c31a68', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/a996dd95d7ef6ee344a1e74a2aad6f2cd4c31a68',parents: [{ id: '310b64cc155ae9ab89e1e81c0200ee57ccb51449' }]},{id: '310b64cc155ae9ab89e1e81c0200ee57ccb51449', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/310b64cc155ae9ab89e1e81c0200ee57ccb51449',parents: [{ id: '860b391ff801a4811fbe83c754deeaa50a0fdd0e' }]},{id: '860b391ff801a4811fbe83c754deeaa50a0fdd0e', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/860b391ff801a4811fbe83c754deeaa50a0fdd0e',parents: [{ id: 'c3a99c727c730600768211bf44a27fdfd3a60a6b' }]},{id: 'c3a99c727c730600768211bf44a27fdfd3a60a6b', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/c3a99c727c730600768211bf44a27fdfd3a60a6b',parents: [{ id: 'e3651f1fc173261f41d577e9c1d41bb1d05c653e' }]},{id: 'e3651f1fc173261f41d577e9c1d41bb1d05c653e', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/e3651f1fc173261f41d577e9c1d41bb1d05c653e',parents: [{ id: 'c90e21803e615b5855c39da9a79678f2f56b9a68' }]},{id: 'c90e21803e615b5855c39da9a79678f2f56b9a68', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/c90e21803e615b5855c39da9a79678f2f56b9a68',parents: [{ id: '5906f1d3b2a43e757f2717c13b301524da20b3f0' }]},{id: '5906f1d3b2a43e757f2717c13b301524da20b3f0', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/5906f1d3b2a43e757f2717c13b301524da20b3f0',parents: [{ id: 'efcc0cb7530c72229512b6f5728668e5049f3916' }]},{id: 'efcc0cb7530c72229512b6f5728668e5049f3916', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/efcc0cb7530c72229512b6f5728668e5049f3916',parents: [{ id: '1f476cfd8f3e77b1b7a34f6bd46a78f33d0b0e26' }]},{id: '1f476cfd8f3e77b1b7a34f6bd46a78f33d0b0e26', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/1f476cfd8f3e77b1b7a34f6bd46a78f33d0b0e26',parents: [{ id: '9ac30cae49762277bff5d2f0d944d47572512325' }]},{id: '9ac30cae49762277bff5d2f0d944d47572512325', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/9ac30cae49762277bff5d2f0d944d47572512325',parents: [{ id: 'f30b3127b5c0e7403ccd4d91018b36cea33281da' }]},{id: 'f30b3127b5c0e7403ccd4d91018b36cea33281da', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/f30b3127b5c0e7403ccd4d91018b36cea33281da',parents: [{ id: '7b65f3f811c06245a493aff53d6a5fe3963b54d9' }]},{id: '7b65f3f811c06245a493aff53d6a5fe3963b54d9', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/7b65f3f811c06245a493aff53d6a5fe3963b54d9',parents: [{ id: 'efb069e978f3669e7e1841fc171b3f14b35b8b80' }]},{id: 'efb069e978f3669e7e1841fc171b3f14b35b8b80', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/efb069e978f3669e7e1841fc171b3f14b35b8b80',parents: [{ id: '7d8f602e25ccd2cdb7983240c69effcdec8d62d4' }]},{id: '7d8f602e25ccd2cdb7983240c69effcdec8d62d4', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/7d8f602e25ccd2cdb7983240c69effcdec8d62d4',parents: [{ id: '4ab24859061a17e4bc283191ddfce587356d7a69' }]},{id: '4ab24859061a17e4bc283191ddfce587356d7a69', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/4ab24859061a17e4bc283191ddfce587356d7a69',parents: [{ id: '0c820a352d9d03a6b3d0af10d73e481ff3f7fb09' }]},{id: '0c820a352d9d03a6b3d0af10d73e481ff3f7fb09', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/0c820a352d9d03a6b3d0af10d73e481ff3f7fb09',parents: [{ id: '8dd200c4ac3f12a576e9d4c9d903c865586a21b8' }]},{id: '8dd200c4ac3f12a576e9d4c9d903c865586a21b8', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/8dd200c4ac3f12a576e9d4c9d903c865586a21b8',parents: [{ id: 'bba5f325e12d921cb216b9d9271087961ebf60b9' }]},{id: 'bba5f325e12d921cb216b9d9271087961ebf60b9', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/bba5f325e12d921cb216b9d9271087961ebf60b9',parents: [{ id: 'b72c05150383466246dcd7c6dfbf046afe25aae4' }]},{id: 'b72c05150383466246dcd7c6dfbf046afe25aae4', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/b72c05150383466246dcd7c6dfbf046afe25aae4',parents: [{ id: 'bdf56beb8f4c7792bab3c0f2eb3b25a06d332199' }]},{id: 'bdf56beb8f4c7792bab3c0f2eb3b25a06d332199', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/bdf56beb8f4c7792bab3c0f2eb3b25a06d332199',parents: [{ id: 'bcbfa5939b3b59953ded9306e52584ad46277c79' }]},{id: 'bcbfa5939b3b59953ded9306e52584ad46277c79', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/bcbfa5939b3b59953ded9306e52584ad46277c79',parents: [{ id: '8f8f537acd876ba4bc16031e73a8594768224b06' }]},{id: '8f8f537acd876ba4bc16031e73a8594768224b06', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/8f8f537acd876ba4bc16031e73a8594768224b06',parents: [{ id: 'dc1bac7889ff962675b01c6a6338b87df6f385eb' }]},{id: 'dc1bac7889ff962675b01c6a6338b87df6f385eb', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/dc1bac7889ff962675b01c6a6338b87df6f385eb',parents: [{ id: '356b3d3e7665d262cffcd2fe73fb2b743c982b0c' }]},{id: '356b3d3e7665d262cffcd2fe73fb2b743c982b0c', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/356b3d3e7665d262cffcd2fe73fb2b743c982b0c',parents: [{ id: '29962b56163e021a08e7d8889801f640f17e1949' }]},{id: '29962b56163e021a08e7d8889801f640f17e1949', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/29962b56163e021a08e7d8889801f640f17e1949',parents: [{ id: '7c4bbb29df612ef01d3006c52a50efd798d9aa20' }]},{id: '7c4bbb29df612ef01d3006c52a50efd798d9aa20', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/7c4bbb29df612ef01d3006c52a50efd798d9aa20',parents: [{ id: '941d3e3387d60ec8dc28a906a91c4a7d0c53d1b9' }]},{id: '941d3e3387d60ec8dc28a906a91c4a7d0c53d1b9', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/941d3e3387d60ec8dc28a906a91c4a7d0c53d1b9',parents: [{ id: '925b25e6f06c66f9c098707023acd6b6af27868f' }]},{id: '925b25e6f06c66f9c098707023acd6b6af27868f', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/925b25e6f06c66f9c098707023acd6b6af27868f',parents: [{ id: 'dce9e2e31628710e2a177864068ad929b8e05276' }]},{id: 'dce9e2e31628710e2a177864068ad929b8e05276', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/dce9e2e31628710e2a177864068ad929b8e05276',parents: [{ id: '728d2bb137ade77e7f0b724b8fcf878168aa6258' }]},{id: '728d2bb137ade77e7f0b724b8fcf878168aa6258', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/728d2bb137ade77e7f0b724b8fcf878168aa6258',parents: [{ id: 'dd347bb1637be237bd27728e036e779ab4ee99be' }]},{id: 'dd347bb1637be237bd27728e036e779ab4ee99be', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/dd347bb1637be237bd27728e036e779ab4ee99be',parents: [{ id: '3b78e38f70dbf083a347dd260caf974e338001fe' }]},{id: '3b78e38f70dbf083a347dd260caf974e338001fe', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/3b78e38f70dbf083a347dd260caf974e338001fe',parents: [{ id: 'bcb593111ef0558afc89192ffea2362d68e1e6ac' }]},{id: 'bcb593111ef0558afc89192ffea2362d68e1e6ac', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/bcb593111ef0558afc89192ffea2362d68e1e6ac',parents: [{ id: '9c5053c2b82675107d03176a939a016ac8161c37' }]},{id: '9c5053c2b82675107d03176a939a016ac8161c37', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/9c5053c2b82675107d03176a939a016ac8161c37',parents: [{ id: '8e875447f0672ccdbc96f3181dfe8c690c9abc8c' }]},{id: '8e875447f0672ccdbc96f3181dfe8c690c9abc8c', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/8e875447f0672ccdbc96f3181dfe8c690c9abc8c',parents: [{ id: 'ba87b943a8491703e1ed0ec7814829689a09bed3' }]},{id: 'ba87b943a8491703e1ed0ec7814829689a09bed3', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/ba87b943a8491703e1ed0ec7814829689a09bed3',parents: [{ id: '6cdddde8ac37737bc928ac0b0f5abc78558f7728' }]},{id: '6cdddde8ac37737bc928ac0b0f5abc78558f7728', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/6cdddde8ac37737bc928ac0b0f5abc78558f7728',parents: [{ id: '3a086a342b6170b6c1068c0f387e0681ce1aa97f' }]},{id: '3a086a342b6170b6c1068c0f387e0681ce1aa97f', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/3a086a342b6170b6c1068c0f387e0681ce1aa97f',parents: [{ id: '1c276275f11a98cd8cc7214f38a09826189d1455' }]},{id: '1c276275f11a98cd8cc7214f38a09826189d1455', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/1c276275f11a98cd8cc7214f38a09826189d1455',parents: [{ id: '1a7c425127f33054a2528186299443d3982c4ba4' }]},{id: '1a7c425127f33054a2528186299443d3982c4ba4', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/1a7c425127f33054a2528186299443d3982c4ba4',parents: [{ id: 'b99a5f4426d341e4e1a14e4b0191481d81ee2aa3' }]},{id: 'b99a5f4426d341e4e1a14e4b0191481d81ee2aa3', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/b99a5f4426d341e4e1a14e4b0191481d81ee2aa3',parents: [{ id: 'f16463b847ae4be5eacc8dcf68cead9ce1df04f1' }]},{id: 'f16463b847ae4be5eacc8dcf68cead9ce1df04f1', href: '/projects/HDF5VOL/repos/pnetcdf-vol/commits/f16463b847ae4be5eacc8dcf68cead9ce1df04f1',parents: []}]);
