Use of vision and sound to classify feller-buncher operational state

  • Authors: Pan, Pengmin; McDonald, Timothy; Smidt, Mathew; Dias, Rafael
  • Publication Year: 2022
  • Publication Series: Scientific Journal (JRNL)
  • Source: International Journal of Forest Engineering
  • DOI: 10.1080/14942119.2022.2037927


Productivity measures in logging involve simultaneous recognition and classification of event occurrence and timing, and the volume of stems being handled. In full-tree felling systems these measurements are difficult to implement in an autonomous manner because of the unfavorable working environment and the abundance of confounding extraneous events. This paper proposed a vision method that used a lowcost camera to recognize feller-buncher operational events including tree cutting and piling. It used a fine K-nearest neighbors (fKNN) algorithm as the final classifier based on both audio and video features derived from short video segments as inputs. The classifier’s calibration accuracy exceeds 94%. The trained model was tested on videos recorded under various conditions. The overall accurate rates for short segments were greater than 89%. Comparisons were made between the human- and algorithm derived event detection rates, events’ durations, and inter-event timing using continuously recorded videos taken during feller operation. Video results between the fKNN model and manual observation were similar. Statistical comparison using the Kolmogorov–Smirnov test to evaluate measured parameters’ distributions (manual versus automated event duration and inter-event timing) did not show significant differences with the lowest P-value among all Kolmogorov–Smirnov tests equal to 0.12. The result indicated the feasibility and potential of using the method for the automatic time study of drive-to-tree feller bunchers.

  • Citation: Pan, Pengmin; McDonald, Timothy; Smidt, Mathew; Dias, Rafael. 2022. Use of vision and sound to classify feller-buncher operational state. International Journal of Forest Engineering. 33(2): 129-138.
  • Keywords: Camera, machine learning, classifier, time study, cut, pile
  • Posted Date: August 2, 2022
  • Modified Date: August 9, 2022
  • Print Publications Are No Longer Available

    In an ongoing effort to be fiscally responsible, the Southern Research Station (SRS) will no longer produce and distribute hard copies of our publications. Many SRS publications are available at cost via the Government Printing Office (GPO). Electronic versions of publications may be downloaded, printed, and distributed.

    Publication Notes

    • This article was written and prepared by U.S. Government employees on official time, and is therefore in the public domain.
    • Our online publications are scanned and captured using Adobe Acrobat. During the capture process some typographical errors may occur. Please contact the SRS webmaster if you notice any errors which make this publication unusable.
    • To view this article, download the latest version of Adobe Acrobat Reader.