This thesis explores the ethical and legal dimensions of web scraping within the framework of Action Design Research (ADR). By addressing the technical, ethical, and legal challenges associated with web scraping, the study aims to enhance data collection capabilities while ensuring compliance with relevant laws and adherence to website guidelines in an ethical manner. Through a comprehensive literature review and qualitative interviews with industry professionals, best practices and ethical guidelines for web scraping are identified. These insights inform the development of a balanced approach to web scraping that emphasizes technical efficiency alongside ethical responsibility.

The findings highlight the critical importance of stakeholder engagement, transparent communication, and updated ethical review in web scraping projects. The research bridges theoretical knowledge with practical application, contributing to both academic advancement and industry practices. It provides a replicable model for responsible and effective web scraping, demonstrating how such activities can be performed ethically and legally.