Automated 3D Computer Vision Model Offers a New Tool to Measure and Understand Dairy Cow Behavior and Welfare

Dairy cows typically rest for 10 or more hours a day, so a dry, clean, and comfortable place—such as a freestall—to lie down and rest is essential for their health, well-being, and production performance. One key factor in whether stalls are comfortable for cows is the ease with which they can get up and down, so it is common on farms for staff to watch for abnormal rising behaviors as part of standard welfare management. In a new study opens in new tab/window in the Journal of Dairy Science opens in new tab/window, published by Elsevier, a Swedish team, in collaboration with Sony Nordic, introduced a new automated model that accurately detects posture transitions in dairy cows. This innovative approach using 3-dimensional (3D) pose estimation offers valuable, unbiased insights into animal welfare and could offer a less time-consuming and more consistent assessment tool for researchers and farmers alike.

Led by Niclas Högberg, DVM, and Adrien Kroese, Eng, Department of Clinical Sciences, Faculty of Veterinary Medicine and Animal Science, Swedish University of Agricultural Sciences, Uppsala, Sweden, the study aimed to develop a reliable method for monitoring the ease with which cows can get up and down in their cubicles, a crucial indicator of overall comfort and well-being.

Adrien Kroese explained, “Evidence points to a clear link between restricted movement for cows and signs of reduced welfare, so it is common to have some kind of observation practice in place to catch signs of movement struggles.”

Traditional methods—which often rely on human observation—can be subjective, sporadic, and time-consuming.

Considering the need for more consistent methods, the study team proposed a novel framework for detecting cow movements, specifically to understand how to measure lying-to-standing transitions from 3D pose estimation data compared with the human eye.

The team employed a 24-hour setup of seven cameras recording a herd of Swedish Holstein and Swedish Red cows. This footage was then used with 3D pose estimation software, which tracks and records movements via a 2D object detector and pose estimator. These datapoints are then fed into convolutional neural networks to detect cow movements in comparison to specific anatomical landmarks on static images from the footage. The result is a 3D map of cows’ movement in their stalls and a selection of which movements indicate the transition to standing.

Dr. Kroese explained, “We then compared the standing data gathered by the software against timestamps in the video annotated by three human observers, which is considered the gold standard for behavioral observations.”

How did the 3D data model hold up in comparison to the human eye? Dr. Kroese said, “The framework was able to detect when a cow was transitioning from lying to standing with the same accuracy as humans. The sensitivity of the detection was over 88%.”

Notably, the results also indicate that the model introduced no more bias compared with human observers.

Although not without limitations, the study’s findings demonstrate the potential of 3D pose estimation to provide objective and reliable data on cow behavior. Dr. Kroese noted, “This technology represents an exciting advancement in our ability to study and monitor animal behavior and welfare. By automatically and accurately detecting posture transitions, we can gain valuable insights into the comfort and well-being of dairy cows.”

The model offers potential to help researchers scale up the study of dairy cow behavior and motion patterns and opens the door to the development of new assessment tools for farmers to make informed decisions about their herds.

Notes for editors

The article is “3-Dimensional pose estimation to detect posture transition in freestall-housed dairy cows,” by Adrien Kroese, Moudud Alam, Elin Hernlund, David Berthet, Lena-Mari Tamminen, Nils Fall, and Niclas Högberg (https://doi.org/10.3168/jds.2023-24427 opens in new tab/window). It appears in the Journal of Dairy Science, volume 107, issue 9 (September 2024), published by the American Dairy Science Association opens in new tab/window and Elsevier opens in new tab/window.

The article is openly available at https://www.journalofdairyscience.org/article/S0022-0302(24)00755-0/fulltext opens in new tab/window and the PDF version is available at https://www.journalofdairyscience.org/action/showPdf?pii=S0022-0302%2824%2900755-0 opens in new tab/window.

Full text of this article is also available to credentialed journalists upon request; contact Eileen Leahy at +1 732 406 1313 or [email protected] opens in new tab/window. Journalists wishing to interview the author should contact Adrien Kroese, Eng, Department of Clinical Sciences, Faculty of Veterinary Medicine and Animal Science, Swedish University of Agricultural Sciences, Uppsala, Sweden, at [email protected] opens in new tab/window.

About the Journal of Dairy Science

The Journal of Dairy Science® (JDS), an official journal of the American Dairy Science Association® (ADSA), is co-published by Elsevier and ADSA. It is the leading general dairy research journal in the world. JDS readers represent education, industry, and government agencies in more than 70 countries, with interests in biochemistry, breeding, economics, engineering, environment, food science, genetics, microbiology, nutrition, pathology, physiology, processing, public health, quality assurance, and sanitation. JDS has a 2023 Journal Impact Factor of 3.7 and five-year Journal Impact Factor of 4.1 according to Journal Citation Reports™ (Source: Clarivate™ 2024). www.journalofdairyscience.org opens in new tab/window

About the American Dairy Science Association (ADSA®)

The American Dairy Science Association (ADSA) is an international organization of educators, scientists, and industry representatives who are committed to advancing the dairy industry and keenly aware of the vital role the dairy sciences play in fulfilling the economic, nutritive, and health requirements of the world’s population. It provides leadership in scientific and technical support to sustain and grow the global dairy industry through generation, dissemination, and exchange of information and services. Together, ADSA members have discovered new methods and technologies that have revolutionized the dairy industry. www.adsa.org opens in new tab/window

About Elsevier

As a global leader in scientific information and analytics, Elsevier helps researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. We do this by facilitating insights and critical decision-making with innovative solutions based on trusted, evidence-based content and advanced AI-enabled digital technologies.

We have supported the work of our research and healthcare communities for more than 140 years. Our 9,500 employees around the world, including 2,500 technologists, are dedicated to supporting researchers, librarians, academic leaders, funders, governments, R&D-intensive companies, doctors, nurses, future healthcare professionals and educators in their critical work. Our 2,900 scientific journals and iconic reference books include the foremost titles in their fields, including Cell Press, The Lancet and Gray’s Anatomy.

Together with the Elsevier Foundation opens in new tab/window, we work in partnership with the communities we serve to advance inclusion and diversity in science, research and healthcare in developing countries and around the world.

Elsevier is part of RELX opens in new tab/window, a global provider of information-based analytics and decision tools for professional and business customers. For more information on our work, digital solutions and content, visit www.elsevier.com.