[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Register      Login
Soil Research Soil Research Society
Soil, land care and environmental research
RESEARCH ARTICLE

Using a legacy soil sample to develop a mid-IR spectral library

R. A. Viscarra Rossel A B C , Y. S. Jeon B , I. O. A. Odeh B and A. B. McBratney A B
+ Author Affiliations
- Author Affiliations

A Australian Centre for Precision Agriculture, Faculty of Agriculture, Food & Natural Resources, The University of Sydney, NSW 2006, Australia.

B Faculty of Agriculture, Food & Natural Resources, The University of Sydney, NSW 2006, Australia.

C Corresponding author. Email: r.viscarra-rossel@usyd.edu.au

Australian Journal of Soil Research 46(1) 1-16 https://doi.org/10.1071/SR07099
Submitted: 13 July 2007  Accepted: 21 November 2007   Published: 8 February 2008

Abstract

This paper describes the development of a diffuse reflectance spectral library from a legacy soil sample. When developing a soil spectral library, it is important to consider the number of samples that are needed to adequately describe the soil variability in the region in which the library is to be used; the manner in which the soil is sampled, handled, prepared, stored, and scanned; and the reference analytical procedures used. As with any type of modelling, the dictum is ‘garbage in = garbage out’ and hopefully the converse ‘quality in = quality out’. The aims of this paper are to: (i) develop a soil mid infrared (mid-IR) diffuse reflectance spectral library for cotton-growing regions of eastern Australia from a legacy soil sample, (ii) derive soil spectral calibrations for the prediction of soil properties with uncertainty, and (iii) assess the accuracy of the predictions and populate the legacy soil database with good quality information. A scheme for the construction and use of this spectral library is presented. A total of 1878 soil samples from different layers were scanned. They originated from the Upper Namoi, Namoi, and Gwydir Valley catchments of north-western New South Wales (NSW) and the McIntyre region of southern Queensland (Qld). A conditioned Latin hypercube sampling (cLHS) scheme was used to sample the spectral data space and select 213 representative samples for laboratory soil analyses. Using these data, partial least-squares regression (PLSR) was used to construct the calibration models, which were validated internally using cross validation and externally using an independent test dataset. Models for organic C (OC), cation exchange capacity (CEC), clay content, exchangeable Ca, total N (TN), total C (TC), gravimetric moisture content θg, total sand and exchangeable Mg were robust and produced accurate results (R2adj. > 0.75 for both cross and test set validations). The root mean squared error (RMSE) of mid-IR-PLSR predictions was compared to those from (blind) duplicate laboratory measurements. Mid-IR-PLSR produced lower RMSE values for soil OC, clay content, and θg. Finally, bootstrap aggregation-PLSR (bagging-PLSR) was used to predict soil properties with uncertainty for the entire library, thus repopulating the legacy soil database with good quality soil information.

Additional keywords: mid-IR diffuse reflectance spectroscopy, spectral library, partial least squares regression, bagging-PLSR, legacy soil data.


Acknowledgments

We wish to acknowledge the Cotton Catchment and Communities CRC (CCC CRC) and the Grains Research and Development Corporation (GRDC) for their financial support.


References


Barnes RJ, Dhanoa MS, Lister SJ (1989) Standard normal variate transformation and de-trending of near-infrared diffuse reflectance spectra. Applied Spectroscopy 43, 772–777.
Crossref | GoogleScholarGoogle Scholar | open url image1

Ben-Dor E, Levin N, Singer A, Karnieli A, Braun O, Kidron GJ (2006) Quantitative mapping of the soil rubification process on sand dunes using an airborne hyperspectral sensor. Geoderma 131, 1–21.
Crossref | GoogleScholarGoogle Scholar | open url image1

Bowers SA, Hanks RJ (1965) Reflection of radiant energy from soils. Soil Science 100, 130–138. open url image1

Brooks FA (1952) Atmospheric radiation and its reflection from the ground. Journal of Meteorology 9, 41–52. open url image1

Brown DJ, Shepherd KD, Walsh MG, Dewayne Mays M, Reinsch TG (2006) Global soil characterization with VNIR diffuse reflectance spectroscopy. Geoderma 132, 273–290.
Crossref | GoogleScholarGoogle Scholar | open url image1

Chang C-W, Laird DA, Mausbach MJ, Hurburgh CR (2001) Near-infrared reflectance spectroscopy-principal components regression analysis of soil properties. Soil Science Society of America Journal 65, 480–490. open url image1

Chong IG, Jun CH (2005) Performance of some variable selection methods when multicollinearity is present. Chemometrics and Intelligent Laboratory Systems 78, 103–112.
Crossref | GoogleScholarGoogle Scholar | open url image1

Cohen MJ, Shepherd KD, Walsh MG (2005) Empirical reformulation of the universal soil loss equation for erosion risk assessment in a tropical watershed. Geoderma 124, 235–252.
Crossref | GoogleScholarGoogle Scholar | open url image1

Dalal RC, Henry RJ (1986) Simultaneous determination of moisture, organic carbon and total nitrogen by near infrared reflectance spectrophotometry. Soil Science Society of America Journal 50, 120–123. open url image1

De Maesschalck R, Jouan-Rimbaud D, Massart DL (2000) The Mahalanobis distance. Chemometrics and Intelligent Laboratory Systems 50, 1–18.
Crossref | GoogleScholarGoogle Scholar | open url image1

Demattê JAM, Campos RC, Alves MC, Fiorio PR, Nanni MR (2004) Visible–NIR reflectance: a new approach on soil evaluation. Geoderma 121, 95–112.
Crossref | GoogleScholarGoogle Scholar | open url image1

Dunn BW, Beecher HG, Batten GD, Ciavarella S (2002) The potential of near-infrared reflectance spectroscopy for soil analysis – a case study from the Riverine Plain of south-eastern Australia. Australian Journal of Experimental Agriculture 42, 607–614.
Crossref | GoogleScholarGoogle Scholar | open url image1

Gee GW , Bauder JW (1986) Particle size analysis. In ‘Methods of soil analysis. Part I’. 2nd edn, Agronomy Monograph 9. (Ed. A Klute) pp. 383–411. (ASA and SSSA: Madison, WI)

de Gruijter J , Brus DJ , Bierkens MFP , Knotters M (2006) ‘Sampling for natural resource monitoring.’ (Springer Verlag)

Haaland DM, Thomas EV (1988) Partial least-squares methods for spectral analyses. 1. Relation to other quantitative calibration methods and the extraction of qualitative information. Analytical Chemistry 60, 1193–1202.
Crossref | GoogleScholarGoogle Scholar | open url image1

Isbell RF (2002) ‘The Australian Soil Classification.’ (CSIRO Publishing: Collingwood, Vic.)

Janik LJ, Merry RH, Skjemstad JO (1998) Can mid infra-red diffuse reflectance analysis replace soil extractions? Australian Journal of Experimental Agriculture 38, 681–696.
Crossref | GoogleScholarGoogle Scholar | open url image1

Janik LJ, Skjemstad JO (1995) Characterisation and analysis of soils using mid-infrared partial least squares. II. Correlations with some laboratory data. Australian Journal of Soil Research 33, 637–650.
Crossref | GoogleScholarGoogle Scholar | open url image1

Madari BE, Reeves JB, Machado PLOA, Guimarães CM, Torres E, McCarty GW (2006) Mid- and near-infrared spectroscopic assessment of soil compositional parameters and structural indices in two Ferralsols. Geoderma 136, 245–259.
Crossref | GoogleScholarGoogle Scholar | open url image1

Martens H , Næs T (1989) ‘Multivariate calibration.’ (John Wiley & Sons: Chichester, UK)

Masserschmidt I, Cuelbas CJ, Poppi RJ, De Andrade JC, De Abreu CA, Davanzo CU (1999) Determination of organic matter in soils by FTIR/diffuse reflectance and multivariate calibration. Journal of Chemometrics 13, 265–273.
3.0.CO;2-E" target="_blank" rel="nofollow noopener noreferrer" class="reftools">Crossref | 3.0.CO;2-E" target="_blank" rel="nofollow noopener noreferrer" class="reftools">GoogleScholarGoogle Scholar | 3.0.CO;2-E&atitle=Determination of organic matter in soils by FTIR/diffuse reflectance and multivariate calibration.&title=Journal of Chemometrics&date=1999&volume=13&spage=265&epage=273&aulast=Davanzo&aufirst=CU" target="_blank" rel="nofollow noopener noreferrer" >open url image1

McBratney AB, Minasny B, Viscarra Rossel RA (2006) Spectral soil analysis and inference systems: a powerful combination for solving the soil data crisis. Geoderma 136, 272–278.
Crossref | GoogleScholarGoogle Scholar | open url image1

Minasny B, McBratney AB (2006) A conditioned Latin hypercube method for sampling in the presence of ancillary information. Computers & Geosciences 32, 1378–1388.
Crossref | GoogleScholarGoogle Scholar | open url image1

Mouazen AM, Maleki MR, De Baerdemaeker J, Ramon H (2007) On-line measurement of some selected soil properties using a VIS–NIR sensor. Soil and Tillage Research 93, 13–27.
Crossref | GoogleScholarGoogle Scholar | open url image1

Nguyen TT, Janik LJ, Raupach M (1991) Diffuse reflectance infrared fourier transform (DRIFT) spectroscopy in soil studies. Australian Journal of Soil Research 29, 49–67.
Crossref | GoogleScholarGoogle Scholar | open url image1

Odeh IOA , Stephen CR , Triantafilis J , McBratney AB , Taylor J (2004) A simple soil database management assistant for Australian cotton industry. In ‘Proceedings of Australian and New Zealand Soils Conference – SuperSoil 2004’. The University of Sydney, NSW. CD-ROM. (ASSSI: Sydney)

Rayment GE , Higginson FR (1992) ‘Australian laboratory handbook of soil and water chemical methods.’ (Inkata Press: Melbourne)

Reeves JB, McCarty GW, Meisinger JJ (1999) Near infrared reflectance spectroscopy for the analysis of agricultural soils. Journal of Near Infrared Spectroscopy 7, 179–193. open url image1

Savitzky A, Golay MJE (1964) Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry 36, 1627–1639.
Crossref | GoogleScholarGoogle Scholar | open url image1

Shepherd KD, Walsh MG (2002) Development of reflectance spectral libraries for characterization of soil properties. Soil Science Society of America Journal 66, 988–998. open url image1

Shibusawa S , Imade Anom SW , Sato S , Sasao A , Hirako S (2001) Soil mapping using the real-time soil spectrophotometer. In ‘ECPA 2001. Third European Conference on Precision Agriculture. Vol. 1’. (Eds G Grenier, S Blackmore) pp. 497–508. (Agro: Montpellier)

Singh B, Heffernan S (2002) Layer charge characteristics of smectites from Vertosols (Vertisols) of New South Wales. Australian Journal of Soil Research 40, 1159–1170.
Crossref | GoogleScholarGoogle Scholar | open url image1

Skjemstad JO, Dalal RC (1987) Spectroscopic and chemical differences in organic matter of two Vertisols subjected to long periods of cultivation. Australian Journal of Soil Research 25, 323–335.
Crossref | GoogleScholarGoogle Scholar | open url image1

Stenberg B , Jonnson A , Borjesson T (2002) Near infrared technology for soil analysis with implications for precision agriculture. In ‘Near Infrared Spectroscopy: Proceedings of the 10th International Conference’. (Eds A Davies, R Cho) pp. 279–284. (NIR Publications: Chichester, UK)

Stenberg B, Nordkvist E, Salomonsson L (1995) Use of near infrared reflectance spectra of soils for objective selection of samples. Soil Science 159, 109–114.
Crossref | GoogleScholarGoogle Scholar | open url image1

Vågen TG, Shepherd KD, Walsh MG (2006) Sensing landscape level change in soil fertility following deforestation and conversion in the highlands of Madagascar using Vis-NIR spectroscopy. Geoderma 133, 281–294.
Crossref | GoogleScholarGoogle Scholar | open url image1

Viscarra Rossel RA (2007) Robust modelling of soil diffuse reflectance spectra by ‘bagging-‘PLSR’. Journal of Near Infrared Spectroscopy 15, 39–47.
Crossref | GoogleScholarGoogle Scholar | open url image1

Viscarra Rossel RA (2008) ParLeS: Software for chemometric analysis of spectroscopic data. Chemometrics and Intelligent Laboratory Systems 90, 72–83.
Crossref | GoogleScholarGoogle Scholar | open url image1

Viscarra Rossel RA , McBratney AB (2008) Diffuse reflectance spectroscopy as a tool for digital soil mapping. In ‘Digital soil mapping with limited data’. Developments in Soil Science series. (Eds AE Hartemink, AB McBratney, L Mendonça-Santos) (Elsevier Science: Amsterdam)

Viscarra Rossel RA, McGlynn RN, McBratney AB (2006b) Determining the composition of mineral-organic mixes using UV-vis-NIR diffuse reflectance spectroscopy. Geoderma 137, 70–82.
Crossref | GoogleScholarGoogle Scholar | open url image1

Viscarra Rossel RA, Walvoort DJJ, McBratney AB, Janik LJ, Skjemstad JO (2006a) Visible, near-infrared, mid-infrared or combined diffuse reflectance spectroscopy for simultaneous assessment of various soil properties. Geoderma 131, 59–75.
Crossref | GoogleScholarGoogle Scholar | open url image1

Wetterlind J , Stenberg B , Soderstrom M (2007) Farmsoil mapping using NIR-technique for increased sample point density. In ‘Precision Agriculture ’07’. (Ed. JV Stafford) pp. 265–270. (Wageningen Academic Publishers: AE Wageningen, The Netherlands)

Williams PC (1987) Variables affecting near-infrared reflectance spectroscopic analysis. In ‘Near-infrared technology in the agricultural and food industries’. (Eds P Williams, K Norris) pp. 143–166. (American Association of Cereal Chemists: St Paul, MN)

Wold S , Martens H , Wold H (1983) The multivariate calibration method in chemistry solved by the PLS method. In ‘Proceedings of the Conference on Matrix Pencils, Lecture Notes in Mathematics’. (Eds A Ruhe, B Kagstrom) pp. 286–293. (Springer-Verlag: Heidelberg)

Wold S, Sjöström M, Eriksson L (2001) PLS-regression: a basic tool of chemometrics. Chemometrics and Intelligent Laboratory Systems 58, 109–130.
Crossref | GoogleScholarGoogle Scholar | open url image1