Author Commit Message Commit Date Muqun Yang 9f820f94258 Update the release.txt for 2.4 release. 02 Dec 2013 Muqun Yang b450851613c Update the readme for the new testing scripts 02 Dec 2013 Muqun Yang 4a84b65160f Final code touch before the release 02 Dec 2013 Muqun Yang 9888bc8ba56 Final checking the code and comments before the release 27 Nov 2013 Muqun Yang 1679c1bdbd3 Slightly updating an error message 26 Nov 2013 Muqun Yang 5251f0689d7 Clean some warnings exposed by gcc Wall and the clang compiler. 22 Nov 2013 Hyo-Kyung Lee fcef9aa2997 AUGEOSFV-20:added path for h5diff. test script doesn't find it automatically. 22 Nov 2013 Hyo-Kyung Lee 50f21ce5966 AUGEOSFV-20:redirect make distclean output to /dev/null. 22 Nov 2013 Hyo-Kyung Lee 3a6031681a9 AUGEOSFV-20:finished the daily test script. 22 Nov 2013 Hyo-Kyung Lee 8695aa01349 AUGEOSFV-20:added a daily test cron job. Catching error and notifying email is not implemented yet. 22 Nov 2013 Muqun Yang ad04ba2878d Revise the output a bit 20 Nov 2013 Muqun Yang f97837654cf Add output infomration in the test scripts 20 Nov 2013 Muqun Yang 0619a69536e Add output information for the tests 20 Nov 2013 Muqun Yang 3f38a97a2db For HDF5 fixed size string, one needs to add another character for the termination. The augmentation tool doesn't add this character. Although h5dump or HDFView shows the full string correctly. h5py picks this up. So fixing the attribute routine in the tool and re-generate the expected files. 18 Nov 2013 Muqun Yang 6ef8cef7928 Updating the testing file
For HDF5 fixed size string, one needs to add another character for the termination. The augmentation tool doesn't add this character. Although h5dump or HDFView shows the full string correctly. h5py picks this up. So fixing the attribute routine in the tool and re-generate the expected files.
_ 18 Nov 2013 Muqun Yang 90b52e15ddb Updating the testing file
For HDF5 fixed size string, one needs to add another character for the termination. The augmentation tool doesn't add this character. Although h5dump or HDFView shows the full string correctly. h5py picks this up. So fixing the attribute routine in the tool and re-generate the expected files. 18 Nov 2013 Muqun Yang dcfbd6ad944 Previously for 1-D unlimited dimension extendible dataset,the chunk size is set to be 1, which may cause really bad performance. Given the fact the dimension scale array may not be very large, I set the chunk size to be 100 instead of 1. 15 Nov 2013 Muqun Yang 1566068de32 Remove some C++ comments 14 Nov 2013 Muqun Yang eb3d3626652 Clean up debugging info in the code 14 Nov 2013 Muqun Yang f8201a553d6 Adding the download scripts for obtaining NASA files on Mac 14 Nov 2013 Muqun Yang 5cbc0e167a5 getopt on Mac OS 10.8 doesn't assign 0 to optopt even if the command-line arguments are right. So add a flag to check the values to by-pass this issue. 14 Nov 2013 Muqun Yang f493c0e9ae9 1. Add the scripts to download NASA files for both the default option and the file/index option 14 Nov 2013 Muqun Yang 21d0873f504 Remove the original download scripts and modify the top level test.sh 14 Nov 2013 Muqun Yang bb83722d6c3 1. Add shell scripts and the mapping files and the dimensional scale data files for NASA HDF-EOS5 files.
2. The real NASA files are huge so a script of downloading the NASA files will be provided in case users whant to test 13 Nov 2013 Muqun Yang d1429a1bf51 1. Add shell scripts to test the fake files for default, file and index options and also to test if the tool correctly handles the augmented file
2. Add fake test files(mostly from the HDF5 OPeNDAP handler) and the corresponding mapping files for the file option
3. Test on 64-bit Linux xile-vm 2.6.18-371.1.2.el5 #1 SMP 13 Nov 2013 Muqun Yang 7270672c5db Turn off the debugging info. for the release 13 Nov 2013 Muqun Yang f91ea775d71 Enhance code to read dimension scale data from an ASCII file
Previously, the tool only supports reading the dimension scale values from an ASCII file that holds the format 'one number per line'. While testing OMI and TES data, I found that some of their dimension scale data are stored in an attribute. HDFView shows the attribute values with commas. For users to conveniently copy the dimension scale data to an ASCII file,the tool had better support the reading of dimension scale data with comm... 12 Nov 2013 Muqun Yang 69735ad2246 AUGEOSFV-14, making the tool read dimension scale ASCII file that have different delimiter such as , as white space 08 Nov 2013 Muqun Yang a403f14d440 AUGEOSFV-8, change the lat/lon names by following user's suggestions 06 Nov 2013 Muqun Yang 48f3be07921 Enhance the error handling code a little bit 01 Nov 2013 Muqun Yang d0f82799720 1. Finish the major coding part to check if the dimension names and the field names in the mapping file match corresponding names in the HDF-EOS5 file
2. Test various combinatios of single grid, multiple grids,single swath, multiple swaths, single zonal and multiple zonal cases.
3. Comments etc. still need to be cleaned up 01 Nov 2013 Muqun Yang a004bbcbe82 AUGEOSFV-14,add a function to check if dimension and field names specified in the mapping file match the HDFEOS5 file 31 Oct 2013 Muqun Yang 4a16b7e5eef AUGEOSFV-14, Add the code to check whether the dimension and the field names in the mapping file match the corresponding names in the HDF-EOS5 file 31 Oct 2013 Muqun Yang 65fe09f1c0f AUGEOSFV-14, add the code to check if HDF-EOS5 object names are specified correctly in the mapping file. 31 Oct 2013 Muqun Yang 52b4471641b AUGEOSFV-14, enhance the code to check the valid field/dimension names 31 Oct 2013 Muqun Yang ecc5f3f3d33 AUGEOSFV-14, check in the code to check if an HDF-EOS5 object name exists in the mapping file 31 Oct 2013 Muqun Yang acb86bb1f67 AUGEOSFV-14, adding code to check if dim/field names in the mapping file exist, also tackling the issue to check the eos object names in a mixed(both grid and swath) HDF-EOS5 file, thirdly, adding the checking of zonal object in the mapping file. 30 Oct 2013 Muqun Yang dd3124ff7ff AUGEOSFV-14, add the code to check the duplicate dim and field names for multiple objects 29 Oct 2013 Muqun Yang c4096225172 AUGEOSFV-14, adding code to check possible duplicate dimension and field names specified in the mapping file, tested with one object case. 29 Oct 2013 Muqun Yang 0ad213148bf Add source codes to output error messages and exit from the program after cleaning up the resources for the following cases of the File option. Previously the tool continues augmenting the file with the default option.
1) If the selection flag is not one of 0,1,2,and 2*, the program should exit with an error.
2) If the selection flag is 2*, previously a seg. fault occurs. Now fixes it with the correct otuput.
3) Dim. names and data field names in the mapping file are checked(coding in progre... 28 Oct 2013 Muqun Yang f0083ae0ecd AUGEOSFV-14, for the file option, the tool continues the augmentation process as the default option even the information in the mapping file is wrong. I started fixing this to output error messages if the user doesn't provide the correct info. in the mapping file 25 Oct 2013 Muqun Yang 88e524b0e04 AUGEOSFV-14, while testing more files and find the tool doesn't support the use of datafield for grid lat and lon. Ideally lat/lon should be calculated via HDF-EOS5 APIs, however, some NASA HDF-EOS5 products don't give the correct project parameters. Instead they provide correct lat/lon fields. So I enhance the tool by providing an option for users to use data fields for lat/lon. Also two helper fucntions check_attribute_existence and delete_attribute are added. Tested with a fake grid file. ... 24 Oct 2013 Muqun Yang e81436968fe AUGEOSFV-14, while testing more files and find the tool doesn't support the use of datafield for grid lat and lon. Ideally lat/lon should be calculated via HDF-EOS5 APIs, however, some NASA HDF-EOS5 products don't give the correct project parameters. Instead they provide correct lat/lon fields. So I enhance the tool by providing an option for users to use data fields for lat/lon. Also two helper fucntions check_attribute_existence and delete_attribute are added. Tested with a fake grid file. ... 24 Oct 2013 Muqun Yang 4c848b194b0 AUGEOSFV-15, adding comments to make the flow clear 22 Oct 2013 Muqun Yang 4d5d1a82e8a AUGEOSFV-10, revised some comments, corrected the error codes and slightly changed the error handling 21 Oct 2013 Muqun Yang 137433f42bb AUGEOSFV-10,revise comments 20 Oct 2013 Muqun Yang e4569bfcfe2 AUGEOSFV-10, revise comments and remove some redundant codes, item 9 of the ticket 18 Oct 2013 Muqun Yang abd075ea294 AUGEOSFV-10, add more comments, this check-in completes item 1-8 of the ticket AUGEOSFV-10. Other small fixes of the code are also applied. 18 Oct 2013 Muqun Yang 7c6c18d1aab AUGEOSFV-10, adding more comments 17 Oct 2013 Muqun Yang c1d89449cfe AUGEOSFV-10, adding more comments on write.c 17 Oct 2013 ← Prev Next → require('plugin/commitgraph/network').applyCommits([{id: '9f820f94258b6b3f2d96fa5e54030e60731fa62b', href: '/projects/HDFEOS/repos/aug_eos5/commits/9f820f94258b6b3f2d96fa5e54030e60731fa62b',parents: [{ id: 'b450851613cf0ae079b91e9070225aa9f2b71497' }]},{id: 'b450851613cf0ae079b91e9070225aa9f2b71497', href: '/projects/HDFEOS/repos/aug_eos5/commits/b450851613cf0ae079b91e9070225aa9f2b71497',parents: [{ id: '4a84b65160ff67237d887989110235ed0f7e3e0b' }]},{id: '4a84b65160ff67237d887989110235ed0f7e3e0b', href: '/projects/HDFEOS/repos/aug_eos5/commits/4a84b65160ff67237d887989110235ed0f7e3e0b',parents: [{ id: '9888bc8ba564397153c4bcb26c8ea5db24439e8b' }]},{id: '9888bc8ba564397153c4bcb26c8ea5db24439e8b', href: '/projects/HDFEOS/repos/aug_eos5/commits/9888bc8ba564397153c4bcb26c8ea5db24439e8b',parents: [{ id: '1679c1bdbd3de5f8cbd36c475ba5bdd27edefa6a' }]},{id: '1679c1bdbd3de5f8cbd36c475ba5bdd27edefa6a', href: '/projects/HDFEOS/repos/aug_eos5/commits/1679c1bdbd3de5f8cbd36c475ba5bdd27edefa6a',parents: [{ id: '5251f0689d76796b36c04779ec4b1cf075492f3a' }]},{id: '5251f0689d76796b36c04779ec4b1cf075492f3a', href: '/projects/HDFEOS/repos/aug_eos5/commits/5251f0689d76796b36c04779ec4b1cf075492f3a',parents: [{ id: 'fcef9aa29971acf66183534dbfe8b9bd58c3571c' }]},{id: 'fcef9aa29971acf66183534dbfe8b9bd58c3571c', href: '/projects/HDFEOS/repos/aug_eos5/commits/fcef9aa29971acf66183534dbfe8b9bd58c3571c',parents: [{ id: '50f21ce5966700404eefedee99ebb0e415a42eaf' }]},{id: '50f21ce5966700404eefedee99ebb0e415a42eaf', href: '/projects/HDFEOS/repos/aug_eos5/commits/50f21ce5966700404eefedee99ebb0e415a42eaf',parents: [{ id: '3a6031681a93fc834492ed4f10e4c2e204a92159' }]},{id: '3a6031681a93fc834492ed4f10e4c2e204a92159', href: '/projects/HDFEOS/repos/aug_eos5/commits/3a6031681a93fc834492ed4f10e4c2e204a92159',parents: [{ id: '8695aa0134939bd3a9ce07bb35b5ff7e509df299' }]},{id: '8695aa0134939bd3a9ce07bb35b5ff7e509df299', href: '/projects/HDFEOS/repos/aug_eos5/commits/8695aa0134939bd3a9ce07bb35b5ff7e509df299',parents: [{ id: 'ad04ba2878d07a57de7ec2a6b5a2de254dabe348' }]},{id: 'ad04ba2878d07a57de7ec2a6b5a2de254dabe348', href: '/projects/HDFEOS/repos/aug_eos5/commits/ad04ba2878d07a57de7ec2a6b5a2de254dabe348',parents: [{ id: 'f97837654cfc5384f3cd1e30c59a4421a60d6a81' }]},{id: 'f97837654cfc5384f3cd1e30c59a4421a60d6a81', href: '/projects/HDFEOS/repos/aug_eos5/commits/f97837654cfc5384f3cd1e30c59a4421a60d6a81',parents: [{ id: '0619a69536ee1035f54198b401a5e16b6d2ad6ad' }]},{id: '0619a69536ee1035f54198b401a5e16b6d2ad6ad', href: '/projects/HDFEOS/repos/aug_eos5/commits/0619a69536ee1035f54198b401a5e16b6d2ad6ad',parents: [{ id: '3f38a97a2db342ba406b0a1f8eb21cf1e20aa2ba' }]},{id: '3f38a97a2db342ba406b0a1f8eb21cf1e20aa2ba', href: '/projects/HDFEOS/repos/aug_eos5/commits/3f38a97a2db342ba406b0a1f8eb21cf1e20aa2ba',parents: [{ id: '6ef8cef7928e3e09612e6f7a718e0e02e9856e35' }]},{id: '6ef8cef7928e3e09612e6f7a718e0e02e9856e35', href: '/projects/HDFEOS/repos/aug_eos5/commits/6ef8cef7928e3e09612e6f7a718e0e02e9856e35',parents: [{ id: '90b52e15ddbe671fe380e2bb614bc4cef0f78a93' }]},{id: '90b52e15ddbe671fe380e2bb614bc4cef0f78a93', href: '/projects/HDFEOS/repos/aug_eos5/commits/90b52e15ddbe671fe380e2bb614bc4cef0f78a93',parents: [{ id: 'dcfbd6ad944f29fbcd29bc0cd7ac2ff8429c9643' }]},{id: 'dcfbd6ad944f29fbcd29bc0cd7ac2ff8429c9643', href: '/projects/HDFEOS/repos/aug_eos5/commits/dcfbd6ad944f29fbcd29bc0cd7ac2ff8429c9643',parents: [{ id: '1566068de323d8dbc64f967c427b275680a14dc7' }]},{id: '1566068de323d8dbc64f967c427b275680a14dc7', href: '/projects/HDFEOS/repos/aug_eos5/commits/1566068de323d8dbc64f967c427b275680a14dc7',parents: [{ id: 'eb3d3626652f51d4310f8bce6634506bea4861ee' }]},{id: 'eb3d3626652f51d4310f8bce6634506bea4861ee', href: '/projects/HDFEOS/repos/aug_eos5/commits/eb3d3626652f51d4310f8bce6634506bea4861ee',parents: [{ id: 'f8201a553d66b9b2396bb2b4b5f1238556e094cf' }]},{id: 'f8201a553d66b9b2396bb2b4b5f1238556e094cf', href: '/projects/HDFEOS/repos/aug_eos5/commits/f8201a553d66b9b2396bb2b4b5f1238556e094cf',parents: [{ id: '5cbc0e167a52dba937dcbae54e7d2582013bdbac' }]},{id: '5cbc0e167a52dba937dcbae54e7d2582013bdbac', href: '/projects/HDFEOS/repos/aug_eos5/commits/5cbc0e167a52dba937dcbae54e7d2582013bdbac',parents: [{ id: 'f493c0e9ae970d1368b792780ac1199f5ec92a32' }]},{id: 'f493c0e9ae970d1368b792780ac1199f5ec92a32', href: '/projects/HDFEOS/repos/aug_eos5/commits/f493c0e9ae970d1368b792780ac1199f5ec92a32',parents: [{ id: '21d0873f504be55877219042c6bb22c5f6c71e32' }]},{id: '21d0873f504be55877219042c6bb22c5f6c71e32', href: '/projects/HDFEOS/repos/aug_eos5/commits/21d0873f504be55877219042c6bb22c5f6c71e32',parents: [{ id: 'bb83722d6c30d60b435a7beea20c2e7639477bd8' }]},{id: 'bb83722d6c30d60b435a7beea20c2e7639477bd8', href: '/projects/HDFEOS/repos/aug_eos5/commits/bb83722d6c30d60b435a7beea20c2e7639477bd8',parents: [{ id: 'd1429a1bf51b887e2d6cff334b155e25c68edcf6' }]},{id: 'd1429a1bf51b887e2d6cff334b155e25c68edcf6', href: '/projects/HDFEOS/repos/aug_eos5/commits/d1429a1bf51b887e2d6cff334b155e25c68edcf6',parents: [{ id: '7270672c5db9b17a26cf4374d1f30ada98b078fc' }]},{id: '7270672c5db9b17a26cf4374d1f30ada98b078fc', href: '/projects/HDFEOS/repos/aug_eos5/commits/7270672c5db9b17a26cf4374d1f30ada98b078fc',parents: [{ id: 'f91ea775d713d5d189d092bc4652cccf8c4c1d03' }]},{id: 'f91ea775d713d5d189d092bc4652cccf8c4c1d03', href: '/projects/HDFEOS/repos/aug_eos5/commits/f91ea775d713d5d189d092bc4652cccf8c4c1d03',parents: [{ id: '69735ad2246bd39a5d9c46605e94694a1ce6e0fd' }]},{id: '69735ad2246bd39a5d9c46605e94694a1ce6e0fd', href: '/projects/HDFEOS/repos/aug_eos5/commits/69735ad2246bd39a5d9c46605e94694a1ce6e0fd',parents: [{ id: 'a403f14d440d9bfb578cfa6e132bd61223e4c944' }]},{id: 'a403f14d440d9bfb578cfa6e132bd61223e4c944', href: '/projects/HDFEOS/repos/aug_eos5/commits/a403f14d440d9bfb578cfa6e132bd61223e4c944',parents: [{ id: '48f3be07921b3d8363346f6e91d10ff810aaa5b0' }]},{id: '48f3be07921b3d8363346f6e91d10ff810aaa5b0', href: '/projects/HDFEOS/repos/aug_eos5/commits/48f3be07921b3d8363346f6e91d10ff810aaa5b0',parents: [{ id: 'd0f827997201ab9c2db89ece1bd0ca8fdc14b77e' }]},{id: 'd0f827997201ab9c2db89ece1bd0ca8fdc14b77e', href: '/projects/HDFEOS/repos/aug_eos5/commits/d0f827997201ab9c2db89ece1bd0ca8fdc14b77e',parents: [{ id: 'a004bbcbe82b9688c41bc263c909b39cae59a158' }]},{id: 'a004bbcbe82b9688c41bc263c909b39cae59a158', href: '/projects/HDFEOS/repos/aug_eos5/commits/a004bbcbe82b9688c41bc263c909b39cae59a158',parents: [{ id: '4a16b7e5eef65048e115d24bbbb1b0795ab0d317' }]},{id: '4a16b7e5eef65048e115d24bbbb1b0795ab0d317', href: '/projects/HDFEOS/repos/aug_eos5/commits/4a16b7e5eef65048e115d24bbbb1b0795ab0d317',parents: [{ id: '65fe09f1c0f88f71f6e105b69b131dd32810637f' }]},{id: '65fe09f1c0f88f71f6e105b69b131dd32810637f', href: '/projects/HDFEOS/repos/aug_eos5/commits/65fe09f1c0f88f71f6e105b69b131dd32810637f',parents: [{ id: '52b4471641bb389020e8bcb42c43f529db77dd56' }]},{id: '52b4471641bb389020e8bcb42c43f529db77dd56', href: '/projects/HDFEOS/repos/aug_eos5/commits/52b4471641bb389020e8bcb42c43f529db77dd56',parents: [{ id: 'ecc5f3f3d339380d626750e261dfafb92ea19ede' }]},{id: 'ecc5f3f3d339380d626750e261dfafb92ea19ede', href: '/projects/HDFEOS/repos/aug_eos5/commits/ecc5f3f3d339380d626750e261dfafb92ea19ede',parents: [{ id: 'acb86bb1f67c0df1ae4900829bf766b5886c890e' }]},{id: 'acb86bb1f67c0df1ae4900829bf766b5886c890e', href: '/projects/HDFEOS/repos/aug_eos5/commits/acb86bb1f67c0df1ae4900829bf766b5886c890e',parents: [{ id: 'dd3124ff7ff69977f54af77de0c66a6a910c9c6a' }]},{id: 'dd3124ff7ff69977f54af77de0c66a6a910c9c6a', href: '/projects/HDFEOS/repos/aug_eos5/commits/dd3124ff7ff69977f54af77de0c66a6a910c9c6a',parents: [{ id: 'c409622517288ea4f7727639f70fbe874e9fbad2' }]},{id: 'c409622517288ea4f7727639f70fbe874e9fbad2', href: '/projects/HDFEOS/repos/aug_eos5/commits/c409622517288ea4f7727639f70fbe874e9fbad2',parents: [{ id: '0ad213148bfa71ca8a1896a7fe04c67174770d8b' }]},{id: '0ad213148bfa71ca8a1896a7fe04c67174770d8b', href: '/projects/HDFEOS/repos/aug_eos5/commits/0ad213148bfa71ca8a1896a7fe04c67174770d8b',parents: [{ id: 'f0083ae0ecd0187ac1e5625eaf04577a983aa114' }]},{id: 'f0083ae0ecd0187ac1e5625eaf04577a983aa114', href: '/projects/HDFEOS/repos/aug_eos5/commits/f0083ae0ecd0187ac1e5625eaf04577a983aa114',parents: [{ id: '88e524b0e04afbe2aa180e7d2019038915fec0a9' }]},{id: '88e524b0e04afbe2aa180e7d2019038915fec0a9', href: '/projects/HDFEOS/repos/aug_eos5/commits/88e524b0e04afbe2aa180e7d2019038915fec0a9',parents: [{ id: 'e81436968fe2a229fbcc30aa1c002dd00f8a0bff' }]},{id: 'e81436968fe2a229fbcc30aa1c002dd00f8a0bff', href: '/projects/HDFEOS/repos/aug_eos5/commits/e81436968fe2a229fbcc30aa1c002dd00f8a0bff',parents: [{ id: '4c848b194b002ef8b5c4a4e5e758e0f72c5b8584' }]},{id: '4c848b194b002ef8b5c4a4e5e758e0f72c5b8584', href: '/projects/HDFEOS/repos/aug_eos5/commits/4c848b194b002ef8b5c4a4e5e758e0f72c5b8584',parents: [{ id: '4d5d1a82e8a0b7ab8e1853377062d078b333be36' }]},{id: '4d5d1a82e8a0b7ab8e1853377062d078b333be36', href: '/projects/HDFEOS/repos/aug_eos5/commits/4d5d1a82e8a0b7ab8e1853377062d078b333be36',parents: [{ id: '137433f42bb472c667abd5a7a42ad7ce7eda1ac5' }]},{id: '137433f42bb472c667abd5a7a42ad7ce7eda1ac5', href: '/projects/HDFEOS/repos/aug_eos5/commits/137433f42bb472c667abd5a7a42ad7ce7eda1ac5',parents: [{ id: 'e4569bfcfe285e4872bb771092741eceb09b740b' }]},{id: 'e4569bfcfe285e4872bb771092741eceb09b740b', href: '/projects/HDFEOS/repos/aug_eos5/commits/e4569bfcfe285e4872bb771092741eceb09b740b',parents: [{ id: 'abd075ea294e7af49f4a7323bd15e372bfd61a2d' }]},{id: 'abd075ea294e7af49f4a7323bd15e372bfd61a2d', href: '/projects/HDFEOS/repos/aug_eos5/commits/abd075ea294e7af49f4a7323bd15e372bfd61a2d',parents: [{ id: '7c6c18d1aab46a5ca0e7f9b9141ad0d9de7c7c33' }]},{id: '7c6c18d1aab46a5ca0e7f9b9141ad0d9de7c7c33', href: '/projects/HDFEOS/repos/aug_eos5/commits/7c6c18d1aab46a5ca0e7f9b9141ad0d9de7c7c33',parents: [{ id: 'c1d89449cfeaeb65c58749980135dd890378235c' }]},{id: 'c1d89449cfeaeb65c58749980135dd890378235c', href: '/projects/HDFEOS/repos/aug_eos5/commits/c1d89449cfeaeb65c58749980135dd890378235c',parents: [{ id: '2d9f4999ac807b295ac0635c6b40e6c13f86ec53' }]}]);
