Skip to contents

soilDB 2.8.2 (development)

  • SoilWeb Web Coverage Service MUKEY grid data source (used for mukey.wcs()) and metadata have been updated for FY2024

    • Note that ISSR800 WCS (ISSR800.wcs() source) are still using FY2023/FY2022 data
  • get_SDA_coecoclass() default data returned for methods “Dominant Component”, “Dominant Condition” and “None” now include localphase column

  • get_soilseries_from_NASIS() and get_competing_soilseries_from_NASIS(): add SS argument for parity with all other NASIS “get” methods

  • default to FALSE for backward compatibility/common use cases

  • Changes in column names (Area table / "areasymbol" related; #172)

    • get_site_data_from_NASIS_db(): Add state, county, and MLRA areasymbol references ("site_state", "site_county", "site_mlra")

    • get_mapunit_from_NASIS_db(): Add dominant MLRA areasymbol reference column "lmapunit_mlra"

    • get_soilseries_from_NASIS(): replace areasymbol column to use relationship-style name "soilseries_typelocst" (minor breaking change)

soilDB 2.8.1 (2024-01-09)

CRAN release: 2024-01-09

  • get_mapunit_from_NASIS(), get_lmuaoverlap_from_NASIS() and get_legend_from_NASIS() gain areatypename argument used for filtering legends by areatypename.
    • Default results include "Non-MLRA Soil Survey Area" and "MLRA Soil Survey Area". Set to NULL for no filter.
  • Fixed bugs in waterDayYear() and summarizeSoilTemperature() for leap years (#333)
  • fetchSoilGrids() upgrades
    • Fixed a bug with data.frame output
    • Requests for more than 5 sites now include a call to Sys.sleep() to conform with ISRIC “Fair Use” policy
    • Upgraded SoilProfileCollection spatial promotion for aqp 2.0+
    • Added 10 kPa, 33 kPa and 1500 kPa water content estimates to default variable sets for point and grid queries
  • fetchSDA_spatial() gains ability to query mapunit delineations by Ecological Site ID (by.col="ecoclassid")
  • get_SDA_coecoclass() default ecoclasstypename is now c("NRCS Rangeland Site", "NRCS Forestland Site"), as this is the most common type of aggregation and is least prone to producing unusual composition-related errors due to duplications
    • Fixed bug related to merging tables/integer data type
    • Fixed bug in calculation of “Not assigned” fraction of mapunits which could result in negative aggregate component percentages below the default threshold

soilDB 2.8.0 (2023-12-22)

CRAN release: 2023-12-22

  • Minimum {aqp} version set to v2.0.2. This is due to changes in the namespace related to aqp::col2Munsell(), to “encourage” users to update to the more efficient routines provided in {aqp} 2+ (if they haven’t already), and prepare for future updates in the 2.x series.
  • Fix bugs in get_SDA_interpretation() when dsn refers to a local SQLite source and in concatenation of reason string when wide_reason=TRUE
  • createSSURGO() updates:
    • Breaking change: Now uses the standard SSURGO layer names for spatial data (e.g. "mupolygon" rather than "soilmu_a").
    • Creates indices for foreign keys and other columns important for data analysis, dramatically improving the performance of standard queries on SQLite sources.
    • Now works properly on STATSGO data sets for individual states or CONUS. Previously tabular data would be transferred but spatial data were not.
  • downloadSSURGO() gains db argument which gives ability to download STATSGO by state or all of US from Web Soil Survey. Thanks to Meghan Krueger for suggestion.
  • get_SDA_property(): weighted average/dominant component numeric methods now return mukey in first column position; for parity with other get_SDA* methods recently updated/already doing this, making it easier to use these columns for raster attribute tables via terra::set.levels()
  • fetchNASIS(lab=TRUE) fixed a bug when multiple phlabresults records are present for a single horizon, but one or both is missing bottom depth. Thanks to Meyer Bohn (@MollicMeyer) for reporting.
  • SoilProfileCollection objects now include a time stamp in their metadata, accessed as: metadata(x)$created (#235)
  • Added area_type argument to fetchLDM() for non-SSA area queries (#328)
  • Added grid argument to fetchSoilGrids() for downloading Cloud-Optimized GeoTIFF subsets for spatial extent (#329)
  • fetchOSD() now automatically batches requests into sets of 100 series, allowing arbitrarily large requests to be made (#239)

soilDB 2.7.10 (2023-11-16)

CRAN release: 2023-11-16

  • fetchSDA_spatial() gains geom.src="mlrapolygon" for obtaining Major Land Resource Area (MLRA) polygon boundaries. When using this geometry source x is a vector of MLRARSYM (MLRA Symbols).

    • The geometry source is the MLRA Geographic Database v5.2 (2022) which is not (yet) part of Soil Data Access. Instead of SDA, GDAL utilities are used to read a zipped ESRI Shapefile from a remote URL: https://www.nrcs.usda.gov/sites/default/files/2022-10/MLRA_52_2022.zip. Therefore, most additional fetchSDA_spatial() arguments are not currently supported for the MLRA geometry source. In the future a mlrapolygon table may be added to SDA (analogous to mupolygon and sapolygon), and the function will be updated accordingly at that time.
  • Web coverage services and related raster attribute tables provided by SoilWeb (mukey.wcs() etc.) are now using the SoilWeb load-balancer URL

  • get_SDA_coecoclass() gains method="all" for aggregating information about ecological sites and related components. The method performs a condition-based aggregation for each ecological site condition in the map unit, producing a “wide” data.frame result with as many columns as needed to portray all site conditions.

  • fetchLDM() gains new argument WHERE for supplying a custom SQL where clause for selecting sites of interest. For example: fetchLDM(WHERE = "CASE WHEN corr_name IS NOT NULL THEN LOWER(corr_name) ELSE LOWER(samp_name) END = 'musick'")

soilDB 2.7.9 (2023-09-01)

  • Added new method options for fetchSDA_spatial(). Aggregation grouping is controlled by the by.col argument. This works for mapunit and survey area polygon geometries, aggregating all polygons in the group for each mukey, nationalmusym, lkey, or areasymbol extent.
    • method="extent" method calculates a bounding rectangle
    • method="convexhull" calculates the convex hull
    • method="union" returns a MULTIPOLYGON
    • method="collection" returns a GEOMETRYCOLLECTION

Bug Fixes

soilDB 2.7.8 (2023-08-29)

CRAN release: 2023-08-29

Bug Fixes

soilDB 2.7.7 (2023-03-10)

CRAN release: 2023-03-10

Enhancements

Bug fixes

  • dbQueryNASIS(..., close=TRUE) now calls dbDisconnect() on.exit() (ensuring connections get closed on error)

  • fetchSCAN():

    • 2x requests when timeseries argument not specified

    • Account for no results (e.g. year = 1800)

    • Bug fix in vectorization when daily + hourly data requested

  • downloadSSURGO():

    • Handle SDA_query() with invalid syntax in WHERE clause

    • Fix for include_template=FALSE

  • createSSURGO()

    • Attribute tables are now added to gpkg_contents when output filename is a GeoPackage
  • Fix for .get_comonth_from_SDA()

  • Fix selected set (SS argument) for get_ecosite_history_from_NASIS_db() in get_site_data_from_NASIS_db()

  • get_SDA_pmgroupname: return NA (not “NULL”) for empty/missing pmgroupname when simplify=TRUE

  • SDA_spatialQuery():

    • geomIntersection=TRUE with db="SAPOLYGON" now correctly labels the areasymbol column (previously was mukey) to match geomIntersection=FALSE and SDA schema

    • Bounding box extent polygons are now only calculated for SpatRaster (not SpatVector) input

soilDB 2.7.6 (2022-11-28)

CRAN release: 2022-12-02

  • All references to soilDB.env have been replaced with a function that returns that environment object (get_soilDB_env()); thanks to @MollicMeyer for identifying this as a problem in #277. This object used to be exported but was unintentionally omitted from NAMESPACE; this has been fixed.

  • fetchNASIS(lab=TRUE) bug fix related to many:1 relationships between lab samples and morphologic horizons with all-missing columns having logical datatype (#277)

  • Added get_SRI() and fetchSRI() functions for accessing USFS Region 6 Soil Resource Inventory information from https://ecoshare.info/; thanks to @joshualerickson for the contribution (https://github.com/ncss-tech/soilDB/pull/274)

  • fetchLDM() now sets the horizon designation metadata like other fetch* functions that return SoilProfileCollection objects (@dylanbeaudette)

  • mukey.wcs() fix spurious warnings occasionally given due to minor differences (rounding) of grid dimensions

  • {curl} has been moved from Suggests to Imports

  • simplfyFragmentData() alias for simplifyFragmentData() removed (@infotroph)

soilDB 2.7.5 (2022-10-17)

CRAN release: 2022-10-18

soilDB 2.7.4 (2022-09-30)

CRAN release: 2022-09-30

soilDB 2.7.3 (2022-08-19)

CRAN release: 2022-08-19

  • get_SDA_property() all methods now support miscellaneous_areas argument. This defaults to FALSE for the methods it was previously implemented for–so be aware that queries using "Dominant Component" or "Dominant Condition" (which previously did not respond to miscellaneous_areas) may have the number of rows in result reduced due to omission of miscellaneous land types. If this is unexpected or undesired, please use miscellaneous_areas=TRUE. (https://github.com/ncss-tech/soilDB/issues/257)

  • Adds get_NASIS_metadata() and helper method get_NASIS_column_metadata() and other new tools for working with uncode(), factors and NASIS metadata cached in the package.

  • Bug fix for get_cosoilmoist_from_SDA(); thanks to Monika Shea @monikashea for reporting the problem (https://github.com/ncss-tech/soilDB/issues/253)

  • fetchNASIS_report() now works with the output from "get_site_from_NASIS" report (useful for site records without associated pedons)

  • createSSURGO() gains arguments quiet and include_spatial to toggle messages and inclusion of spatial data in created SQLite database, respectively

  • downloadSSURGO() now handles queries against sacatalog that return no results more gracefully

  • get_OSD(): Add fix_ocr_errors argument for result='json' to fix common optical character recognition errors associated with horizon designations and colors (NOTE: does NOT fix depths)

  • fetchSCAN() gains timeseries argument to support batch downloads of hourly data. Additional arguments (...) are passed as a raw request, allowing other parameters sent in request to be modified if needed, and bypassing batch functionality. This is similar to the req argument syntax used in earlier versions of this function, which had been deprecated for some time now. Thanks to Matthew Morriss for raising the discussion item @morrismc99 (https://github.com/ncss-tech/soilDB/discussions/260).

  • {curl} moved from Suggests to Imports; curl::curl_download() is now used instead of utils::download.file() because it seems to handle SSL certificates better on some networks.

soilDB 2.7.2 (2022-06-24)

CRAN release: 2022-06-27

  • fetchNASIS("components'): Fix and refactor ( breaking change from 2.7.1, which introduced a bug/inconsistency) of recent change; duplicates argument is now required to merge in data from mapunit/legend tables (where many:1 relationships between legend/mapunit and datamapunit are possible). In 2.7.1 possibly incomplete mapunit/legend tables could be joined to SoilProfileCollection result (if and only if the tables were populated in selected set/local DB). Does not change historic (<=2.7.0) default behavior. Thanks to @dylanbeaudette for suggesting use of get_component_correlation_data_from_NASIS_db() here.

  • Several fixes for Roxygen documentation (notably for ROSETTA() and various NASIS web report related functions) that were missing @export tags. Several previously-exported functions missed being explicitly exported in the new Roxygen-generate NAMESPACE. These unintentional omissions from 2.7.1 NAMESPACE have been resolved.

  • Fixes an old bug in fetchSDA()/get_chorizon_from_SDA() related to LEFT OUTER versus RIGHT JOIN to chtexture table

soilDB 2.7.1 (2022-06-10)

CRAN release: 2022-06-10

  • get_SDA_coecoclass() better handling of NULL ecoclassref; support for filtering on ecoclasstypename; not_assigned_value now applies to ecoclassname, ecoclasstypename and ecoclassref columns in addition to ecoclassid; Thanks to Andy Paolucci and Jason Nemecek. Also, added additional columns from legend/mapunit tables (areasymbol, lkey, muname).
  • fetchNASIS(from="components") now returns mapunit and legend information (if loaded in local NASIS database); results now contain mustatus and repdmu which can be used to remove components from additional mapunits and non-representative data mapunits; thanks to Nathan Roe
  • Convert UTF-8 strings in us_ss_timeline result to ASCII
  • SDA_query(): Fixed POST request that could produce unhandled errors on network failure (now returns try-error like other error-causing code)
  • SDA_query(): In the event of a syntax error, error contents are now returned as a message, not a warning.
  • uncode() and code() now work with data.table and tibble objects.
  • Various fixes to tests and error handling code to reduce likelihood of thrown errors from network problems or missing suggested packages.

soilDB 2.7.0 (2022-05-18)

CRAN release: 2022-05-18

  • Spatial
    • Dropped imports from sp and raster which means soilDB no longer requires the soon-to-retire rgdal package.
    • All spatial data processing has been moved to sf and terra, which have been added to Suggests.
      • (breaking change) Classes from these packages (e.g. sf, SpatRaster) will be returned by default rather than Spatial*DataFrame or RasterLayer from sp and raster.
      • (breaking change) Spatial functions that take spatial input will return the same class type as the input unless otherwise specified.
        • fetchSDA_spatial() and SDA_spatialQuery() gain as_Spatial argument; when TRUE equivalent (backward compatible) sp and raster data types are returned.
        • Alternately, you may set options(soilDB.return_Spatial=TRUE)
    • mukey.wcs() and ISSR800.wcs() bug fix for some instances where the target extent was miscalculated, resulting in slight differences from requested resolution (res argument) of result.
    • mukey.wcs() gains a new possible data source db="RSS" which accesses a Web Coverage Service containing grids from Raster Soil Surveys in the United States.
    • See: https://github.com/ncss-tech/soilDB/pull/229 for more details on what has changed.
  • NASIS
    • (breaking change) rmHzErrors argument now defaults to FALSE. Please let us know if allowing horizon errors results in unexpected behavior so we can repair various interfaces that rely on no errors being present. See aqp::checkHzDepthLogic() for more information on the types of things that used to result in profiles being removed from results and for guidelines on how to fix.
    • Added several new columns from the plotplantinventory table to get_vegplot_species_from_NASIS_db() result; thanks to Zachary Van Abbema for suggestion and feedback
    • Local NASIS metadata used for uncode() are now cached within an R session which results in faster query processing times for users with a local NASIS database connection set up.
      • The db argument to uncode() has been deprecated. Now, code() and uncode() can use ChoiceName and/or ChoiceLabel in coding and decoding ChoiceValue for all data sources.
    • Rock fragment and artifact sieving now uses <76mm as the upper boundary for gravel fraction, and a related QC message has been removed
  • SSURGO / Soil Data Access
    • Added get_SDA_cosurfmorph(): a new function in “SSURGO On Demand” style. Users can customize the WHERE clause, target tables and the grouping variable used to calculate proportions (default by="compname")
      • “cosurfmorphgc” summarizes “geomposmntn”, “geomposhill”, “geomposflats”, “geompostrce”
      • “cosurfmorphhpp” summarizes “hillslopeprof”
      • “cosurfmorphss” summarizes “shapeacross”, “shapedown”, and concatenated “surfaceshape”
    • Several fixes for logic of get_SDA_property() with method="weighted average" and include_minors=TRUE/miscellaneous_areas=TRUE, thanks to Andy Paolucci and Dylan Beaudette for testing and providing feedback on the queries.
    • All get_SDA_*() methods (except get_SDA_metrics()) now support input of custom WHERE clause in lieu of mukeys/areasymbols arguments and gain a dsn argument for specifying a local SQLite database or DBIConnection.
    • Added downloadSSURGO() for downloading/extraction of the SSURGO data by survey area from Web Soil Survey.
    • Added createSSURGO() for building of local databases as SQLite/Geopackage from one or more SSURGO exports.

soilDB 2.6.15 (2022-04-13)

CRAN release: 2022-04-14

  • fetchNASIS()
    • New mixColors argument used to toggle color mixing for pedon horizons with multiple colors per moisture state.
      • Default TRUE mixes colors based on reported color percentage via estimateColorMixture(). FALSE returns the dominant color in each moisture state, or first record for cases without colorpct populated.
    • Added taxreaction and taxfamhahatmatcl to extended taxonomic information
    • Added new option (soilDB.NASIS.skip_uncode) to bypass uncode() in NASIS functions (mostly used for debugging or special database instances that come pre-decoded)
    • An instance in fetchNASIS(from="components") where local database connection was left open was fixed
  • Added fetchLDM() function to access Kellogg Soil Survey Lab Data Mart via Soil Data Access or local SQLite snapshot (https://github.com/ncss-tech/soilDB/pull/243)
  • Added get_SDA_metrics() for accessing usage metrics for Soil Data Access, Web Soil Survey and the Lab Data Mart. Thanks to Jason Nemecek for submitting the base SQL query
  • get_SDA_interpretation(method = "dominant condition") now includes total_comppct_* columns reflecting the summed component percentage of the dominant condition
  • Updated metadata for SCAN sites that were missing pedlabsampnum (KSSL Pedon Sample ID)

soilDB 2.6.14 (2022-03-15)

CRAN release: 2022-03-15

  • waterYearDay() bug fix for more specific (sub-daily) date-time formats
  • fetchSCAN() better handling of empty results in multi-site queries
  • Updates to queries, metadata and sample datasets for NASIS 7.4.1 Database Model
    • fetchNASIS("pedons") no longer includes pmweathering
    • fetchNASIS("components") no longer includes ecositeorigin
    • New Component Ecological Site attributes added
  • stringsAsFactors argument to soilDB functions has been deprecated in favor of a package option
    • Default behavior for NASIS domains is to return character labels rather than coded factors
    • Use NASISDomainsAsFactor(TRUE) to toggle package option soilDB.NASIS.DomainsAsFactor

soilDB 2.6.13 (2022-01-29)

CRAN release: 2022-01-31

  • fetchSDA_spatial now supports by.col "areaname", "mlraoffice", and "mouagencyresp"; thanks to suggestion by Jay Skovlin
  • fetchNASIS fix for multiple site observation records with surface fragments; thanks to bug report from Brianna Wegner
  • waterYearDay() use format and timezone for start date conversion
  • fetchNASIS fix for from="components", SS=FALSE and queries where no NASIS local database is present (e.g. from SQLite source)
  • Update to NASIS_table_column_keys dataset of NASIS primary and foreign keys by table name to include many more tables
  • fetchVegdata() no longer errors for child table queries unless site/site observation/vegetation plot records are missing
  • fetchOSD(extended=TRUE) now returns an element "NCCPI" containing the National Commodity Crop Production Index summaries. The values returned are quantiles at the 1, 5, 25, 50, 75, 95, and 99% levels over all SSURGO components with compname matching series for irrigated and non-irrigated condition.

soilDB 2.6.12 (2022-01-07)

CRAN release: 2022-01-08

  • get_SDA_property() now works with mixed component and horizon-level properties; thanks to Matthieu Stigler for the bug report
  • Added get_SDV_legend_elements() for fetching and parsing XML for Soil Data Viewer / Web Soil Survey-style symbol themes for soil interpretations from Soil Data Access
  • fetchNASIS() pedon and component geomorphic summaries now include columns for landscape, microfeature, microrelief, 2D/3D morphometry, and slope shape
  • fetchNASIS('pedons') now uses simplifyFragmentData() for surface fragments

soilDB 2.6.11 (2021-12-21)

  • fetchSDA() handle NULL component-level results with an informative error
  • fetchSDA() now (again) returns mapunit/legend-level information via get_mapunit_from_NASIS()
  • createStaticNASIS() and queries to SQLite NASIS snapshots now preserve date/time using RSQLite 2.2.4+ via extended_types=TRUE argument to dbConnect()
  • get_soilseries_from_NASIS() now returns soiltaxclasslastupdated as a date/time and stores the year in calculated column soiltaxclassyearlastupdated
  • Added several tables to thematic groups in get_NASIS_table_name_by_purpose()
  • fetchOSD() gains surface shape proportions in extended shape_across and shape_down tables
  • SDA_spatialQuery() what='mukey' now works with db='STATSGO'
  • Added metadata to loafercreek, gopheridge and mineralKing
  • waterYearDay() pass through format argument for POSIX time conversion

soilDB 2.6.10 (2021-12-14)

CRAN release: 2021-12-15

  • waterDayYear() and .formatDates() allow optional format and tz argument; used for consistent POSIX time conversion in tests where date/time has granularity finer than one day
  • fetchSDA() extensions for better handling of components with no horizon data
  • SDA_spatialQuery() and processSDA_WKT() fully use {sf}, replacing {sp} in these contexts
  • SDA_spatialQuery() gains argument byFeature to use multiple single-feature queries and combine the results with a unique feature ID specified by idcol argument. This allows for specific feature intersection results without secondary spatial overlay of the polygons (https://github.com/ncss-tech/soilDB/issues/222)
  • dbConnectNASIS() no longer requires that the NASIS credentials option be set if the dsn argument is specified.
  • Rebuilt loafercreek, gopheridge and mineralKing from latest fetchNASIS() results.

soilDB 2.6.9 (2021-12-02)

CRAN release: 2021-12-03

soilDB 2.6.8 (2021-11-05)

  • fetchNASIS() upgrades: use data.table and base internally for data aggregation
  • fetchNASIS("components") now “sieves” rock fragments and human artifacts using same routines as for pedons; respects nullFragsAreZero argument
  • fetchKSSL(..., returnGeochemicalData = TRUE) safely returns 0-length data.frame when no data available

soilDB 2.6.7 (2021-10-27)

soilDB 2.6.6 (2021-09-24)

soilDB 2.6.5 (2021-08-19)

CRAN release: 2021-08-21

  • API calls that return geometry in projected coordinates (AEA/NAD83) now use ESPG:5070 instead of EPSG:6350

soilDB 2.6.4 (2021-08-06)

  • fetchNASIS(from="pedons") now supports fill=TRUE argument just like from="components" to include pedons that have no horizon records
  • createStaticNASIS(): column order should match NASIS, even if data types require reorder for ODBC driver
  • fetchSoilGrids() bug fixes, updates to metadata and references in documentation (https://github.com/ncss-tech/soilDB/issues/201)
    • Corrected the conversion factor used for predicted nitrogen values (conversion from cg/kg to g/kg)
    • Corrected the conversion factor used for uncertainty in bdod and nitrogen (SoilGrids uncertainty layer always uses factor of 10 to create integers)
    • Improved error handling
    • Added progress and verbose arguments for text progress bar and additional message output
    • Added support for {sf} and {sp} POINT geometry inputs
  • Add get_SDA_coecoclass() SOD-style method for mapunit/component level summaries of ecological site and other vegetation class information

soilDB 2.6.3 (2021-07-22)

CRAN release: 2021-07-23

  • SDA_query() and all functions that call SDA_query() get proper column class handling (related to #190), however:
    • be careful with the use of CAST(): unknown datatypes may not be correctly interpreted
    • previous column classes that were incorrectly guessed by type.convert() may have changed (e.g. component.wei)
  • SDA_spatialQuery() can now be used to return soil survey area symbols or geometry using what="areasymbol" or what="sapolygon", respectively
  • Added new columns to soil classification (“SC”) table result of get_soilseries_from_NASIS(); now including taxonomic mineralogy class which may contain multiple parts for series with strongly contrasting control sections
  • Updates to get_SDA_*() methods
    • Extends get_SDA_property(property = ...) and get_SDA_interpretation(rulename = ...) vectorization over property/rulename to work with any aggregation method.
      • Now supports: Dominant Condition, Min, Max, Dominant Component, Weighted Average
    • Add query_string argument (default: FALSE). Set as TRUE to skip submitting query to SDA, instead returning a string of the query that would have been sent instead of data.frame result
    • get_SDA_property: better handling of NULL, miscellaneous areas, and property-specific weighting
      • Remove ISNULL(x, 0) logic that affected weighted averages in presence of missing data
      • Conditional calculation of horizon weights considering NULL values for requested properties (unique weights for each property)
      • New default argument include_minors=FALSE includes only components where majcompflag = 'Yes' in result
      • New default argument miscellaneous_areas=FALSE removes miscellaneous land types compkind values from result
      • Organic and bedrock layers are no longer removed from “Weighted Average”, “MIN” or “MAX” aggregations
    • get_SDA_interpretation: added argument not_rated_value with default value of NA to set “not rated”” values across methods/queries. For backwards compatibility with original SQL use not_rated_value = 99.0
    • Standardizing MUKEY column name (and other keys) as lowercase in results
    • More informative error messages for bad input / arguments inconsistent with specified method
  • Thanks to @hammerly who pointed out weighted averaging of NASIS phlabresults wasn’t working as expected and for highlighting some more improvements (https://github.com/ncss-tech/soilDB/issues/192)
  • get_OSD() TXT and HTML formats now supported (in addition to JSON) through a common function interface
  • Added get_NASIS_table_key_by_name() get_NASIS_fkey_by_name(), get_NASIS_pkeyref_by_name(), get_NASIS_pkey_by_name(), get_NASIS_table_name_by_purpose() methods for helping get information on primary/foreign keys and thematic groups of NASIS tables (useful for creating SQLite/external snapshots of NASIS tables)
  • get_mapunit_from_NASIS(), get_legend_from_NASIS() and get_lmuaoverlap_from_NASIS() now works for “MLRA Survey Area” areatypename and no longer is limited by constraints on legendsuituse or mustatus

soilDB 2.6.2 (2021-05-14)

CRAN release: 2021-05-16

  • Added formativeElement argument to taxaExtent() (SoilWeb taxon extent function)
    • “Formative elements” are derived from the dictionary provided by the {SoilTaxonomy} package (https://cran.r-project.org/package=SoilTaxonomy)
    • For example: taxaExtent("abruptic", level = 'subgroup', formativeElement = TRUE) will get an 800m grid (for SSURGO data in CONUS) showing extent of taxa that have “abruptic” in subgroup-level taxon name
  • fetchNASIS(from="pedons") result now contains the "taxclname" (full family-level taxon name) field from the NASIS pedon table; this value is calculated based on contents of petaxhistory child table
  • get_SDA_interpretation and get_SDA_property now support aggregation method="NONE" allowing for returning properties, classes and ratings for individual components or horizons (https://github.com/ncss-tech/soilDB/pull/181)
  • ISSR800.wcs and mukey.wcs now return a result that inherits from try-error (and a message) if the Web Coverage Service query fails

soilDB 2.6.1 (2021-04-07)

CRAN release: 2021-04-18

  • Connections to local NASIS and various MS Access databases now use DBI and odbc, replacing RODBC
  • New methods dbConnectNASIS and dbQueryNASIS for NASIS access with read-only credentials, fetching query results, and closing the DBIConnection upon completion
  • NASIS methods use dsn argument to specify a local “static” SQLite file containing NASIS tables, or custom DBIConnection to a database with NASIS schema
    • Default dsn = NULL uses "nasis_local" ODBC connection to local NASIS SQL Server
  • Horizon depth logic checking is now done with aqp::checkHzDepthLogic(), powered by {data.table}
  • Added several new SDA query methods based on https://github.com/ncss-tech/ssurgoOnDemand by @jneme910 and @cferguso:
    • get_SDA_property, get_SDA_interpretation, get_SDA_muaggatt, get_SDA_hydric, get_SDA_pmgroupname

soilDB 2.6.0 (2021-02-18)

  • OSDquery gets a new argument (everything) for searching the entire document
  • fetchNASIS(..., rmHzErrors=TRUE) – spurious removals of data due to missing “extended” records. fetchNASIS now uses aqp::horizons<- after building a minimal SoilProfileCollection from NASIS site and horizon tables. This allows aqp integrity methods to trigger where needed–preventing unintentional re-ordering or removals of “valid” horizon data.

soilDB 2.5.9 (2021-01-26)

CRAN release: 2021-01-26

  • HenryTimeLine moved to {sharpshootR} package
  • new functions mukey.wcs() and ISSR800.wcs() for hitting web coverage service (WCS) for gSSURGO, gNATSGO, and ISSR-800 grids
  • new function ROSETTA() for accessing the new ROSETTA model API (c/o Todd Skaggs, USDA-ARS)
  • fetchOSD(..., extended=TRUE) gains geographically associated soils, parsed from OSD (thanks AGB)
  • fetchSDA_spatial now can return soil survey area polygons using geom.src = "sapolygon" with x as a vector of area symbols (areasymbol) or legend keys (lkey). For sapolygon results, the method and add.field arguments work the same as for mupolygon, only now both geometries can be returned with fields from the legend table.
  • fetchSDA_spatial now can return STATSGO gsmmupolygon geometry with db = "STATSGO"; these data are linked to mapunit and (national) legend just like mupolygon.

soilDB 2.5.8 (2020-10-20)

CRAN release: 2020-10-21

  • fetchNASIS / soilDB:::.rockFragmentSieve now uses fragment RV, soilDB:::.sieve uses < operator (https://github.com/ncss-tech/soilDB/issues/1)
  • fetchKSSL(..., returnMorphologicData=TRUE) now returns redoximorphic features by horizon
  • new function taxaExtent returns 800m gridded taxonomic grids for CONUS
  • seriesExtent can now return 800m gridded series extents for CONUS
  • SDA_spatialQuery can now retrieve SSURGO and STATSGO geometry c/o dschlaep (https://github.com/ncss-tech/soilDB/issues/141)
  • new import: data.table; beginning to implement data.table-aware methods in aqp and soilDB

soilDB 2.5.7 (2020-09-03)

  • add fetchGDB for querying tabular data from SSURGO/gNATSGO/STATSGO File Geodatabases
  • add get_NOAA_GHCND() and get_NOAA_stations_nearXY() for batch queries of NOAA Daily Climate Data (requires free API token)
  • bug fix for fetchSDA_spatial with chunk.size > 1 resulting in duplicate data in result
  • major improvements to fetchSDA_spatial to handle queries that exceed JSON Serialization Limit
  • add fetchSoilGrids for point data queries to SoilGrids v2 API with SoilProfileCollection output
  • fetchKSSL(..., returnGeochemicalData=TRUE) now returns geochemical, optical and XRD/thermal data

soilDB 2.5.6 (2020-06-16)

  • bug fixes in fetchKSSL related to vectorization, all arguments vectorized except for bbox
  • KSSL_VG_model output cleaned-up, now returns phi -> theta function

soilDB 2.5.3 (2020-03-22)

  • fetchKSSL is now fully vectorized and builds on new SoilWeb JSON API

soilDB 2.5.2 (2020-02-05)

soilDB 2.5.1 (2020-01-29)

  • bug fix for fetchNASIS(from='components', fill=TRUE, rmHzErrors=TRUE) in context of new ::hzDepthTests() and non-unique chiid due to NA values introduced by fill

soilDB 2.5 (2020-01-23)

CRAN release: 2020-01-28

  • CRAN release
  • simplifyColorData and mix_and_clean_colors always use CIELAB colorspace for weighted averages, and best-available metric for transformation to Munsell notation
  • fetchSDA_spatial - new fetch function that simplifies getting spatial data associated with a vector of mukey or nationalmusym. The function has options for customizing result attribute table and is designed to automatically use makeChunks() to prevent timeout on large queries.
  • aqp::test_hz_logic is now deprecated – refactored affected fetch functions

soilDB 2.4.3 (2020-01-07)

soilDB 2.4 (2019-11-05)

soilDB 2.3.9 (2019-07-25)

  • SDA_query() no longer writes temporary files, c/o suggestion from Kyle Bocinsky (#106 / #108)
  • fetchOSD() gets a sanity check to protect against going over GET request limits
  • makeChunks() added to util functions, useful for splitting data before sending API calls

soilDB 2.3.8 (2019-03-22)

soilDB 2.3.7 (2019-03-12)

  • sharpshootR added to SUGGESTS
  • fetchHenry() and fetchSCAN() now include water year/day (Oct 1 – Sep 30)
  • HenryTimeLine() convenience function added
  • bug fix in fetchOSD(..., extended=TRUE) when no climate data available
  • bug fix in SDA_query()

soilDB 2.3.6 (2019-02-12)

soilDB 2.3.5 (2019-01-14)

CRAN release: 2019-01-14

  • NAMESPACE and R CMD check fixes
  • documentation updates
  • soilDB now suggests stringr
  • new tests
  • release to CRAN

soilDB 2.3.3 (2018-12-18)

  • bug fix in fetchNASIS() related to conversion of NULL fragment volume to 0
  • fetchKSSL() can now automatically simplify colors with simplifyColors = TRUE

soilDB 2.3 (2018-11-17)

CRAN release: 2018-11-19

  • new function for exploring soil series co-occurrence data: siblings()
  • fetchOSD(..., extended=TRUE) gets competing soil series
  • new tests
  • removed old sample gSSURGO chunk and related documentation
  • release to CRAN

soilDB 2.2-6 (2018-10-11)

  • new function for spatial queries: SDA_spatialQuery(), still needs testing and documentation

soilDB 2.2-6 (2018-10-11)

  • fetchOSD() gets an overhaul, new API and features

soilDB 2.2-5 (2018-10-05)

  • experimental interface to SoillWeb OSD fulltext search: OSDquery()

soilDB 2.2-4 (2018-09-04)

soilDB 2.2-1 (2018-05-21)

  • get_mutext_from_NASIS_db() added for extraction of map unit text notes

soilDB 2.2 (2018-05-08)

soilDB 2.1-1 (2018-03-29)

soilDB 2.1 (2018-03-12)

soilDB 2.0-4 (2018-03-06)

  • bug fix for subtle change in how SCAN data are returned from webservice

soilDB 2.0-3 (2018-02-13)

  • bug fix for simplifyFragmentData(, nullFragsAreZero=FALSE), still more work to do

soilDB 2.0-2 (2018-01-29)

  • bug fix for simplifyFragmentData() when fragment volume > 100%

soilDB 2.0-1 (2018-01-23)

CRAN release: 2018-01-23

  • updated loafercreek and gopheridge sample datasets and manual page to reflect latest fetchNASIS

soilDB 2.0 (2017-12-23)

CRAN release: 2018-01-11

  • bug fixes, manual page updates, and stabilization of NASIS interaction
  • released to CRAN

soilDB 1.8.12 (2017-09-19)

  • bug fix in fetchHenry(), it is now possible to query only sensor metadata

soilDB 1.8.11 (2017-08-17)

soilDB 1.8.10 (2017-08-10)

  • re-write of mix_and_clean_colors() so that color mixing happens in CIE LAB space

soilDB 1.8.5 (2017-05-24)

  • re-write of SDA_query(), better error handling, support for multi-part result sets

soilDB 1.8.2 (2017-03-24)

  • fetchHenry() can now access water level data, see manual page

soilDB 1.8.1 (2017-01-23)

  • new function: get_comonth_from_NASIS_db() see manual page for details

soilDB 1.8-10 (2016-12-27)

  • converting all URLs to ‘HTTPS’, addressing bugs with fetchSCAN() and associated functions

soilDB 1.8-7 (2016-11-16)

CRAN release: 2016-11-10

  • sanity checks for fetchHenry()
  • SCAN_sensor_metadata() vectorized and documented
  • unique row names in SPDF returned by seriesExtent()

soilDB 1.8-6 (2016-11-04)

  • converted all links to SoilWeb servers to HTTPS
  • converted all NRCS web-service links to HTTPS

soilDB 1.8-4 (2016-10-07)

  • fetchOSD() now returns dry colors and the source “narrative” for each horizon; function gains an argument
  • fetchOSD() now returns texture class, coarse fragment modifier, pH, and pH class
  • fetchSCAN() re-written, see manual pages and http://ncss-tech.github.io/AQP/soilDB/fetchSCAN-demo.html

soilDB 1.8 (2016-04-29)

CRAN release: 2016-04-29

  • fetchKSSL() can now query basic morphologic data with the argument “returnMorphologicData”
  • two new functions for simplifying NASIS color and fragment data:
    • simplifyFragmentData()
    • simplifyColorData()
  • ^^^ these new functions are now used by fetchNASIS() to summarize color and fragment data (vs. SQL)
  • NOTE: soilDB now uses reshape2::dcast() instead of reshape::cast()

soilDB 1.7 (2016-04-18)

CRAN release: 2016-02-16

  • bug fix in colors returned by fetchNASIS(), reported by Andy Paolucci
  • bug fix in SDA_query(), due to changes in httr::content. Thanks Kyle Bocinsky for the fix!
  • SDA_query() now returns SQL errors generated by SDA
  • new columns from NASIS site table returned by fetchNASIS()
  • NASIS pedon ecosite data now returned by fetchNASIS() (c/o J. Skovlin)

soilDB 1.6.9 (2015-12-28)

  • clean-up in local NASIS queries, removed extra parentheses
  • NASIS component query function overhaul: previous code may be broken, details pending

soilDB 1.6.8 (2015-12-22)

  • added temperature class (temp_class) field from the pedon taxonomic history table (NASIS) [addition suggested by J. Baker]

soilDB 1.6.7 (2015-12-16)

  • experimental function for processing SDA queries that return geometry: processSDA_WKT()

soilDB 1.6.5 (2015-12-03)

  • bug fix for poorly specified geomorphic descriptions, caused fetchNASIS() to barf
  • fetchKSSL() gains new query filters, see man page

soilDB 1.6.4 (2015-11-27)

  • package re-org, getting ready for soilDB 2.0:
    • dropping use of RCurl functions in favor of httr alternatives (done)
    • switch from reshape to reshape2 (pending)
    • possibly move some packages from SUGGESTS to IMPORTS

soilDB 1.6.3 (2015-11-20)

  • new spatial query helper functions for SDA
  • re-named SSURGO_spatial_query() to SoilWeb_spatial_query(), this function may be phased-out due to spatial support now available in SDA
  • removed MUKEYS_by_ll_bbox() function, no longer needed and web-service may be disabled at any time
  • mapunit_geom_by_ll_bbox() will probably be removed in the near future with an SDA-based alternative
  • KSSL data updated (server-side) to June 2015 snapshot, “site_id” column removed from fetchKSSL() results

soilDB 1.6 (2015-08-19)

  • soilDB now imports from the reshape package, will transition to reshape2 with soilDB 2.0
  • fetchHenry() officially added, complete with documentation
  • SDA_query() undergoing some upgrades, no longer requires SSOAP / XMLSchema packages
  • SSOAP / XMLSchema packages no longer in ‘suggests’ list

soilDB 1.5-8 (2015-08-13)

  • fetchKSSL() gets an argument for downloading data by MLRA

soilDB 1.5-7 (2015-03-10)

  • updated the loafercreek and gopheridge sample datasets

soilDB 1.5-3 (2015-03-10)

  • nullFragsAreZero argument to fetchNASIS() reset to TRUE, new documentation pending
  • consolidate of messages printed when running fetchNASIS()
  • introduction of new option “soilDB.verbose” (default is FALSE) for increasing the level of QC information printed
  • new tutorial on fetchNASIS()

soilDB 1.5-2 (2015-02-24)

CRAN release: 2015-02-25

  • RODBC temporarily moved from “suggested” package to “imported” package… not a good idea, reverted to “suggested”

soilDB 1.4-5 (2015-01-20)

  • mix_and_clean_colors() now returns back-transformed, mixed, munsell colors
  • added psctopdepth and pscbotdepth back to extended NASIS query (particle size control section depths)

soilDB 1.4-3 (2015-01-12)

  • get_hz_data_from_NASIS_db() no longer assumes fragment volume of NULL = 0
  • get_extended_data_from_NASIS_db() no longer assumes fragment volume of NULL = 0
  • fetchNASIS() has a new argument, nullFragsAreZero=FALSE; set to TRUE for past NULL -> 0 conversion

soilDB 1.4-2 (2014-12-23)

  • new internally-used function .formatLandformString() for flattening NASIS/PedonPC “landform” records
  • new internally-used function .formatParentMaterialString() for flattening NASIS/PedonPC “parent material” records
  • fetchNASIS() incorporates the results of these two new functions
  • new function SSURGO_spatial_query() queries SSURGO data from SoilWeb (see manual page for details)

soilDB 1.4 (2014-11-13)

  • moving most of the hard-to-install packages into suggests, and checking for package availability at function runtime. this will make soilDB more portable, as not every user will want or need all functionality.

soilDB 1.3-6 (2014-10-27)

  • fetchNASIS() gains argument rmHzErrors to optionally retain pedons with horizonation errors. use with caution.

soilDB 1.3-5 (2014-09-25)

soilDB 1.3 (2014-02-26)

  • Changes made to fetch functions to accommodate changes implemented in the NASIS 6.3 data structure
  • get_site_data_from_NASIS_db(): in cases where multiple records in site-bedrock exist, retain only the most shallow
  • fetchRaCA() has a new argument for querying data by rcasiteid

soilDB 1.2-9 (2014-01-06)

  • SOC concentration and stock values are temporarily disabled in fetchRaCA()
    • waiting for new estimates from the Soil Survey Center…

soilDB 1.2-6 (2013-12-05)

CRAN release: 2013-12-17

  • added new function contributed by J.M. Skovlin: get_veg_from_NPS_PLOTS_db()
  • bug fixes in get_extended_data_from_NASIS_db(): results from geomorph tables are now returned

soilDB 1.2-3 (2013-10-25)

  • added new function fetchSCAN() for downloading soil/climate data from USDA-NRCS SCAN stations (still experimental!)

soilDB 1.2-1 (2013-09-12)

  • bug fixing in fetchRaCA():
    • “#” characters no longer cause errors
    • duplicate IDs in source data have been fixed

soilDB 1.2 (2013-08-13)

  • fetchRaCA() function now stable, ready for general usage
  • fixed bug in fetchRaCA() function where the presence of single-quote character in horizon designation would throw and error

soilDB 1.1-3 (2013-07-30)

  • new function get_copedon_from_NASIS_db(): returns basic information associated with pedons linked to component data in NASIS
  • new function fetchRaCA(): gets data from the Rapid Carbon Assessment project [work in progress]

soilDB 1.1 (2013-06-27)

  • get_site_data_from_NASIS_db() no longer has problems when more than 1 site bedrock kind is defined; only the shallowest row is returned

soilDB 1.0 (2013-04-04)

CRAN release: 2013-04-18

  • fetchNASIS() is now much more efficient: faster / less memory used
  • new function! fetchKSSL(): experimental interface to (most of) the KSSL data
    • queries can be performed by series name or GCS bounding box
    • data are delivered via CA Soil Resource Lab server

soilDB 0.9-8 (2013-04-03)

  • fetchOSD() now immune to queries for non-soils
  • improved efficiency in fetch* functions
  • NASIS-DMU fetching functions now return more information, still not as complete as pedon-queries

soilDB 0.9-7 (2013-03-01)

  • NASIS query functions now return only records from the selected set, please test older code!

soilDB 0.9-6 (2013-02-26)

CRAN release: 2013-02-28

  • new function get_text_notes_from_NASIS_db() – still needs proper documentation
  • bug fixes to PedonPC and NASIS queries, new data elements returned by extended query functions
  • SoilWeb queries via URL are now URL-encoded to allow for spaces in soil series names

soilDB 0.9-4 (2013-01-31)

  • new function: fetchOSD() returns basic OSD data as a SoilProfileCollection

soilDB 0.9-3 (2013-01-08)

CRAN release: 2013-01-10

  • speed-bump in color-fetching functions from NASIS/pedonPC
  • fetchNASIS() now attempts to correct for >1 pedon/site by appending peiid to pedon_id

soilDB 0.9-2 (2012-12-18)

  • new functions for getting / plotting the geographic extent of a soil series, using the SoilWeb query service: +seriesExtent() : fetches extent as a SpatialPolygonDataFrame +seriesExtentAsGmap() : fetches extent and plots on Google Maps (requires dismo package)

soilDB 0.9-1 (2012-11-27)

  • updated functionality in fetchNASIS_component_data() pulls mapunit-level data as well as component-level data
  • Munsell ‘value’ is now returned from PedonPC/NASIS fetching functions

soilDB 0.9 (2012-10-24)

  • added a surface fragment summary “surf_frag_summary” to the results of get_extended_data_from_NASIS()
    • note: this has not been ported to the related PedonPC queries
  • integrated surf_frag_summary data into data returned from fetchNASIS(), stored in @site
    • note: this has not been ported to the related PedonPC queries
  • minor bug-fix in horizon-level rock fragment summary SQL which previously mis-classified BD as ST in some, rare cases
    • note: this has not been ported to the related PedonPC queries

soilDB 0.8-3 (2012-09-28)

CRAN release: 2012-10-10

  • site-level data: {elev, slope, aspect} are now named {elev_field, slope_field, aspect_field}
    • this affects the data returned by fetchNASIS() and fetchPedonPC()

soilDB 0.8-2 (2012-08-23)

  • compatible with NASIS 6.2
  • bug fixes
  • taxhistory selection method is preserved in the results
  • ‘taxonname’ is used instead of ‘sampled_as’ / ’correlated_as, seems to work, but needs further testing

soilDB 0.8 (2012-08-20)

  • updating for PedonPC 5.0 and NASIS 6.2
    • site data contains the best-guessed corresponding row from the taxhistory table, based on:
      1. most recent record, or 2) record with the least amount of missing data
    • taxhistory data are now included in the output from get_extended_data_from_pedon_db()
  • package is now partially compatible with NASIS 6.2

soilDB 0.6 (2012-06-19)

  • tidying up documentation, package dependencies, and NAMESPACE

soilDB 0.5-6 (2012-04-16)

  • adding preliminary functions for querying component data from local NASIS
  • fixed minor bug in SDA_query() and added some links to related documentation

soilDB 0.5-1 (2012-02-22)

  • fetchNASIS() and fetchPedonPC() now integrate `extended’ data
  • warning and error messages cleaned-up
  • multiple textures no longer cause duplicate HZ rows (NASIS only)
  • extended queries now split frags/para-frags
  • silt fraction is estimated from 100-(sand+clay) when possible
  • added local NASIS ODBC connection vignette (thanks JMS)
  • removed dsn argument from NASIS functions as it should always be ‘nasis_local’
  • new wide-formatted, boolean representation of diagnostic horizon data
  • queries standardized between NASIS/PedonPC
  • new fetchNASIS() function for 1-line access to local NASIS data
  • new sample data set ‘loafercreek’
  • basic vignette added, switching to knitr-style vignettes

soilDB 0.3-3 (2012-01-10)

CRAN release: 2012-01-16

  • SDA_query() now functional on MacOS/UNIX-like OSes with (SSOAP 0.8-1, XMLSchema 0.6-0, and XML 3.7-1), thanks to D.T. Lang for the updates!
  • moving hard to find packages to ‘suggested’ status: SSOAP, RCurl, XML, rgdal
  • new wrapper function fetchPedonPC() for typical site/pedon/hz queries
  • new function getHzErrorsPedonPC() for ID-ing pedons with problem horizonation
  • NOTE: hz data queries will return 2 rows/hz (error) when multiple texture classes are assigned to a single horizon- this is a bug, not a feature!

soilDB 0.3-2 (2011-12-30)

CRAN release: 2012-01-03

  • NASIS/pedonPC queries synced
  • minor bug fixes and documentation updates
  • updated query structure, switching over to native NASIS/PedonPC IDs
  • extended summaries added: NASIS only

soilDB 0.2 (2011-12-27)

  • moved functions out of aqp package
  • basic query functionality from local NASIS DB (Jay)

soilDB 0.1 (2011-12-23)

  • initial version on r-forge
  • functions still exist in aqp package… need to move over completely