Gytis Bernotas Gytis.Bernotas@uwe.ac.uk
Research Fellow in Computer Vision and Machine Learning
3D plant phenotyping system using photometric stereo
Bernotas, Gytis
Authors
Abstract
Tracking and predicting the growth performance of plants in different environments is critical for future crop development, which is under dual pressure from population expansion and global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared to manual assessments. This thesis presents the development of PS-Plant - a low-cost and portable 3D Plant Phenotyping (PP) platform based on an imaging technique novel to PP called Photometric Stereo. The suitability of photometric stereo for imaging vegetation was investigated through empirical leaf tissue reflectance measurements which showed that Near-InfraRed (NIR) wavelengths are better suited for this purpose than the visible light. This was further affirmed during PS-Plant validation procedure that involved estimation of the surface area and angle of calibration objects and leaf tissue under white and NIR illumination, achieving state-of-the-art results - a mean relative error of 1.09% for area and a mean absolute error of 1.28 degrees for angle estimations. During this project, a large-scale PS-Plant database of annotated Arabidopsis thaliana leaves of 41 plant individuals grown in different environmental conditions captured in over 470 sessions was made available to the public, which is believed to be the first of its kind. The work introduced six image modalities captured the PS-Plant database, which were used to train two state-of-the-art instance segmentation Neural Network (NN) architectures for automated leaf segmentations. It was concluded that grayscale mages attained the highest scores for both architectures when compared to other investigated modalities and attained a mean symmetric best dice score of 64.1 and 80.3% for two of the investigated neural networks. Further, the differences in performance were established for data splitting technique for training and validating the NN architectures with time-series images of growing plants. The proposed data acquisition and processing pipeline was utilised in a use-case study to extract, in an automated manner, traits of varying complexity from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movements of plants grown under a matrix of different conditions. The work has shown that PS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small and largescale research and will help to accelerate bridging of the phenotype-to-genotype gap.
Thesis Type | Thesis |
---|---|
Publicly Available Date | Aug 23, 2019 |
Keywords | 3D, Arabidopsis thaliana, computer vision, leaf angle, leaf reflectance, low-cost, segmentation, machine learning, near-infrared (NIR) LED, Photometric Stereo, plant phenotyping, Raspberry Pi |
Public URL | https://uwe-repository.worktribe.com/output/1490917 |
Contract Date | Aug 22, 2019 |
Award Date | Mar 18, 2019 |
Files
3D Plant Phenotyping System Using Photometric Stereo 22/8/19
(150.6 Mb)
PDF
You might also like
Photometric stereo technique suitability study for plant phenotyping
(2017)
Presentation / Conference Contribution
Downloadable Citations
About UWE Bristol Research Repository
Administrator e-mail: repository@uwe.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search