Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bug fix for extremely large index files #1

Open
wants to merge 91 commits into
base: master
Choose a base branch
from
Open

Bug fix for extremely large index files #1

wants to merge 91 commits into from

Commits on Jun 5, 2017

  1. Merge pull request #5 from nasa-gibs/master 

    Module will use an updated configuration if one exists in the request…
    @lucianpls
    lucianpls authored Jun 5, 2017
    Configuration menu
    Copy the full SHA
    5fcf74f View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2018

  1. Fixed gzipped tile content handling 

    The gzipped content gets sent as such if the request headers declare support for gzip
Otherwise, mod_deflate is used to inflate the content.
If mod_deflate is not found when needed, a warning is issued
Visual Studio project updated to VS2017
    @lucianpls
    lucianpls committed Jun 4, 2018
    Configuration menu
    Copy the full SHA
    a2763ed View commit details
    Browse the repository at this point in the history

  2. Correct ungzip condition

    @lucianpls
    lucianpls committed Jun 4, 2018
    Configuration menu
    Copy the full SHA
    2ce0988 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2018

  1. Fix for MRFs with index files larger than 2GB 

    c->size.z is 64bit, which will promote the math to 64bit, signed.
This is safe until the index file is under 2^63 - 1 bytes.
    @lucianpls
    lucianpls committed Aug 2, 2018
    Configuration menu
    Copy the full SHA
    bda9529 View commit details
    Browse the repository at this point in the history

  2. Upgrade to libapr-2 

    libpar-2 is still in dev, but it seems to work fine
    @lucianpls
    lucianpls committed Aug 2, 2018
    Configuration menu
    Copy the full SHA
    fe8aa10 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2018

  1. Fix subrequest use and memmory leak 

    - Use the subrequest filter stack for receive instead of the main request.  This allows stacking of filters
- Clean up the subrequest when done
    @lucianpls
    lucianpls committed Aug 19, 2018
    Configuration menu
    Copy the full SHA
    00cc7b7 View commit details
    Browse the repository at this point in the history

  2. VS project cleanup

    @lucianpls
    lucianpls committed Aug 19, 2018
    Configuration menu
    Copy the full SHA
    6bd6755 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2018

  1. Minor Makefile changes

    @lucianpls
    lucianpls committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    8f6718d View commit details
    Browse the repository at this point in the history

  2. define debug mode LOG statement

    @lucianpls
    lucianpls committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    59daa99 View commit details
    Browse the repository at this point in the history

  3. Use DEST, not MOD_PATH

    @lucianpls
    lucianpls committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    f8c5d99 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2018

  1. Implement retries for source failures 

    Retry fetching data from remote source when the initial request fails.
The number to set is in addition to the first fetch.  By default it will try 5 times.
    @lucianpls
    lucianpls committed Nov 2, 2018
    Configuration menu
    Copy the full SHA
    e053452 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2018

  1. Allow debug flag to be set in Makefile.lcl

    @lucianpls
    lucianpls committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    0376eeb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/lucianpls/mod_mrf

    @lucianpls
    lucianpls committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    0dc59f5 View commit details
    Browse the repository at this point in the history

  3. Fixes for parsing input configuration files, error reporting

    @lucianpls
    lucianpls committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    4551853 View commit details
    Browse the repository at this point in the history

  4. More configuration error checking, better error message

    @lucianpls
    lucianpls committed Dec 19, 2018
    Configuration menu
    Copy the full SHA
    4340bea View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2018

  1. Add win x64 project

    @lucianpls
    lucianpls committed Dec 20, 2018
    Configuration menu
    Copy the full SHA
    90c8d9d View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2019

  1. minor cleanup

    @lucianpls
    lucianpls committed Feb 19, 2019
    Configuration menu
    Copy the full SHA
    55746c3 View commit details
    Browse the repository at this point in the history

  2. Changes for split MRF files 

    Untested
    @lucianpls
    lucianpls committed Feb 19, 2019
    Configuration menu
    Copy the full SHA
    2e6486d View commit details
    Browse the repository at this point in the history

  3. Fix source size and range check

    @lucianpls
    lucianpls committed Feb 19, 2019
    Configuration menu
    Copy the full SHA
    3740562 View commit details
    Browse the repository at this point in the history

  4. Fix memset call 

    Is this even necessary?
    @lucianpls
    lucianpls committed Feb 19, 2019
    Configuration menu
    Copy the full SHA
    929459c View commit details
    Browse the repository at this point in the history

  5. Add Indirect directive 

    When set, the module only responds to internal subrequests
    @lucianpls
    lucianpls committed Feb 19, 2019
    Configuration menu
    Copy the full SHA
    491928d View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2019

  1. Elevated Indirect flag to httpd configuration 

    Makes more sense to have the indirect flag in the httpd configuration.

Also moved the index read in a separate function
    @lucianpls
    lucianpls committed Feb 20, 2019
    Configuration menu
    Copy the full SHA
    5ec0d1b View commit details
    Browse the repository at this point in the history

  2. Corrected documentation 

    MRF_RegExp appears in the apache configuration, not in the control file
    @lucianpls
    lucianpls committed Feb 20, 2019
    Configuration menu
    Copy the full SHA
    dbc120a View commit details
    Browse the repository at this point in the history

  3. Update README.md

    @lucianpls
    lucianpls authored Feb 20, 2019
    Configuration menu
    Copy the full SHA
    1f7f499 View commit details
    Browse the repository at this point in the history

  4. Update README.md

    @lucianpls
    lucianpls authored Feb 20, 2019
    Configuration menu
    Copy the full SHA
    306c046 View commit details
    Browse the repository at this point in the history

  5. Update README.md

    @lucianpls
    lucianpls committed Feb 20, 2019
    Configuration menu
    Copy the full SHA
    784b476 View commit details
    Browse the repository at this point in the history

  6. Update README.md

    @lucianpls
    lucianpls committed Feb 20, 2019
    Configuration menu
    Copy the full SHA
    94c68a0 View commit details
    Browse the repository at this point in the history

  7. Update README.md

    @lucianpls
    lucianpls committed Feb 20, 2019
    Configuration menu
    Copy the full SHA
    522b4d1 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2019

  1. Update README.md

    @lucianpls
    lucianpls authored Mar 1, 2019
    Configuration menu
    Copy the full SHA
    9d1bf42 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2019

  1. consistent use of module configuration

    @lucianpls
    lucianpls committed Apr 11, 2019
    Configuration menu
    Copy the full SHA
    92a63dd View commit details
    Browse the repository at this point in the history

  2. Fix read_index function

    @lucianpls
    lucianpls committed Apr 11, 2019
    Configuration menu
    Copy the full SHA
    af5e17e View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2019

  1. Deprecate Redirect directive 

    Use DataFile that starts with : instead
    @lucianpls
    lucianpls committed Apr 16, 2019
    Configuration menu
    Copy the full SHA
    3864ed1 View commit details
    Browse the repository at this point in the history

  2. a few more changes 

    This module needs a complete rewrite, based on libahtse
    @lucianpls
    lucianpls committed Apr 16, 2019
    Configuration menu
    Copy the full SHA
    83c92e3 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2019

  1. Compiles against libahtse

    @lucianpls
    lucianpls committed Apr 17, 2019
    Configuration menu
    Copy the full SHA
    1c9fd1d View commit details
    Browse the repository at this point in the history

  2. Removed header 

    Single source file module
    @lucianpls
    lucianpls committed Apr 17, 2019
    Configuration menu
    Copy the full SHA
    61a82bf View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2019

  1. Use libahtse more

    @lucianpls
    lucianpls committed Apr 20, 2019
    Configuration menu
    Copy the full SHA
    1b7c732 View commit details
    Browse the repository at this point in the history

  2. User the AHTSE TiledRaster

    @lucianpls
    lucianpls committed Apr 20, 2019
    Configuration menu
    Copy the full SHA
    58b4c67 View commit details
    Browse the repository at this point in the history

  3. Forced mime type no longer supported

    @lucianpls
    lucianpls committed Apr 20, 2019
    Configuration menu
    Copy the full SHA
    14ad82c View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2019

  1. Update README.md

    @lucianpls
    lucianpls authored Apr 21, 2019
    Configuration menu
    Copy the full SHA
    f7b3ef5 View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @lucianpls
    lucianpls authored Apr 21, 2019
    Configuration menu
    Copy the full SHA
    d5ef141 View commit details
    Browse the repository at this point in the history

  3. Removed unused function

    @lucianpls
    lucianpls committed Apr 21, 2019
    Configuration menu
    Copy the full SHA
    0789746 View commit details
    Browse the repository at this point in the history

  4. removed mrf directive 

    Presence of mrf regexp is sufficient
    @lucianpls
    lucianpls committed Apr 21, 2019
    Configuration menu
    Copy the full SHA
    36b0253 View commit details
    Browse the repository at this point in the history

  5. No need for mrf prefix for local functions

    @lucianpls
    lucianpls committed Apr 21, 2019
    Configuration menu
    Copy the full SHA
    1d80f4a View commit details
    Browse the repository at this point in the history

  6. Treat the old Redirect directive correctly

    @lucianpls
    lucianpls committed Apr 21, 2019
    Configuration menu
    Copy the full SHA
    9245105 View commit details
    Browse the repository at this point in the history

  7. better error message

    @lucianpls
    lucianpls committed Apr 21, 2019
    Configuration menu
    Copy the full SHA
    3e32ef9 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2019

  1. wrote vfile_pread 

    Virtualized file pread, handles redirects or local files
    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    c682da6 View commit details
    Browse the repository at this point in the history

  2. Use vfile_pread

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    b26394a View commit details
    Browse the repository at this point in the history

  3. Removed unused code 

    Functionality should move to the vfile functions
    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    8793c37 View commit details
    Browse the repository at this point in the history

  4. small cleanup

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    a19cc7c View commit details
    Browse the repository at this point in the history

  5. cleanup

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    c58be51 View commit details
    Browse the repository at this point in the history

  6. configuration cleanup

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    f7e0203 View commit details
    Browse the repository at this point in the history

  7. Update mod_mrf.cpp

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    389f02d View commit details
    Browse the repository at this point in the history

  8. debugged 

    Runs, no file handle caching, both local and remote files
    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    796804b View commit details
    Browse the repository at this point in the history

  9. match libahtse variable rename

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    41ffc37 View commit details
    Browse the repository at this point in the history

  10. file handle reuse per connection

    @lucianpls
    lucianpls committed Apr 22, 2019
    Configuration menu
    Copy the full SHA
    8d77b83 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2019

  1. Document Dynamic directive

    @lucianpls
    lucianpls committed Apr 23, 2019
    Configuration menu
    Copy the full SHA
    14a8fa6 View commit details
    Browse the repository at this point in the history

  2. Finally, canned index functionality

    @lucianpls
    lucianpls committed Apr 23, 2019
    Configuration menu
    Copy the full SHA
    000d49f View commit details
    Browse the repository at this point in the history

  3. linux fixes

    @lucianpls
    lucianpls committed Apr 23, 2019
    Configuration menu
    Copy the full SHA
    509b4d7 View commit details
    Browse the repository at this point in the history

  4. Add AllowParams HTTP configuration directive

    @lucianpls
    lucianpls committed Apr 23, 2019
    Configuration menu
    Copy the full SHA
    3a07e08 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2019

  1. Change and documented allow params directive

    @lucianpls
    lucianpls committed Apr 24, 2019
    Configuration menu
    Copy the full SHA
    96d748c View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2019

  1. Merge pull request #6 from lucianpls/canned-index 

    Canned index
    @lucianpls
    lucianpls authored Apr 25, 2019
    Configuration menu
    Copy the full SHA
    45870a9 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2019

  1. minor tweaks

    @lucianpls
    lucianpls committed May 10, 2019
    Configuration menu
    Copy the full SHA
    e311535 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2019

  1. Allow parameters by default

    @lucianpls
    lucianpls committed Jul 25, 2019
    Configuration menu
    Copy the full SHA
    6cef464 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2019

  1. Send missing tile on the negative side of area

    @lucianpls
    lucianpls committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    caf382f View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2019

  1. Load module a bit later

    @lucianpls
    lucianpls committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    49a67cb View commit details
    Browse the repository at this point in the history

  2. More portable Makefile

    @lucianpls
    lucianpls committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    da903e1 View commit details
    Browse the repository at this point in the history

  3. swap only if needed

    @lucianpls
    lucianpls committed Oct 24, 2019
    Configuration menu
    Copy the full SHA
    e40562e View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2019

  1. Map the selector to file name prefix

    @lucianpls
    lucianpls committed Oct 30, 2019
    Configuration menu
    Copy the full SHA
    759050b View commit details
    Browse the repository at this point in the history

  2. Minor bug fixes, initial test passed.

    @lucianpls
    lucianpls committed Oct 30, 2019
    Configuration menu
    Copy the full SHA
    b183b42 View commit details
    Browse the repository at this point in the history

  3. Document new option 

    Should write a HOWTO to make it easier to understand
    @lucianpls
    lucianpls committed Oct 30, 2019
    Configuration menu
    Copy the full SHA
    6b1087d View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2019

  1. Merge pull request #7 from lucianpls/mapm 

    Mapm
    @lucianpls
    lucianpls authored Nov 1, 2019
    Configuration menu
    Copy the full SHA
    2dd4b0b View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2019

  1. Make only the unmodified data and index files subject to dynamic flag 

    This will improve performance for m-dimensional tile services, while still preserving the fast response for the "current" data
    @lucianpls
    lucianpls committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    7a0e70c View commit details
    Browse the repository at this point in the history

  2. Not a server configuration error for requesting invalid M values

    @lucianpls
    lucianpls committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    c815eb2 View commit details
    Browse the repository at this point in the history

  3. dangling else

    @lucianpls
    lucianpls committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    fb92ce3 View commit details
    Browse the repository at this point in the history

  4. parameters are accepted by default

    @lucianpls
    lucianpls authored Nov 14, 2019
    Configuration menu
    Copy the full SHA
    7f11ef2 View commit details
    Browse the repository at this point in the history

  5. fix condition for 500 or 400 errors

    @lucianpls
    lucianpls committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    b4ab77a View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2020

  1. Set up vs2019, x64, Debug

    @lucianpls
    lucianpls committed Feb 11, 2020
    Configuration menu
    Copy the full SHA
    460636b View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2020

  1. Matching libahtse lerc1 branch

    @lucianpls
    lucianpls committed Dec 9, 2020
    Configuration menu
    Copy the full SHA
    7caa1b1 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2020

  1. Merge pull request #8 from lucianpls/lerc1 

    Matching libahtse lerc1 branch
    @lucianpls
    lucianpls authored Dec 11, 2020
    Configuration menu
    Copy the full SHA
    c592eb7 View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @lucianpls
    lucianpls authored Dec 11, 2020
    Configuration menu
    Copy the full SHA
    17c4c6f View commit details
    Browse the repository at this point in the history

  3. Update README.md

    @lucianpls
    lucianpls authored Dec 11, 2020
    Configuration menu
    Copy the full SHA
    9113ef4 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2021

  1. slightly better makefiles

    @lucianpls
    lucianpls committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    41ddb73 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2021

  1. Update makefiles

    @lucianpls
    lucianpls committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    95cbedc View commit details
    Browse the repository at this point in the history

  2. Add run path variable

    @lucianpls
    lucianpls committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    420c89c View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2021

  1. separate libicd

    @lucianpls
    lucianpls committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    1ab833f View commit details
    Browse the repository at this point in the history

  2. fix gcc warnings

    @lucianpls
    lucianpls committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    92278c7 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2021

  1. Merge pull request #10 from lucianpls/icd 

    Icd
    @lucianpls
    lucianpls authored Jul 8, 2021
    Configuration menu
    Copy the full SHA
    971c28b View commit details
    Browse the repository at this point in the history

Commits on May 27, 2022

  1. VS 2022 project update

    @lucianpls
    lucianpls committed May 27, 2022
    Configuration menu
    Copy the full SHA
    ebe84e7 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. Update mod_mrf.vcxproj

    @lucianpls
    lucianpls committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    ce649e2 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. update to vs x64 build

    @lucianpls
    lucianpls committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    fc7d638 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Add exports as needed

    @lucianpls
    lucianpls committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    9108442 View commit details
    Browse the repository at this point in the history