Senior Back-end Engineer

Role Overview

A Full Stack Engineer is responsible for designing, developing, and maintaining automated systems to collect, parse, and store data from various sources. This role supports business intelligence, market research, and data analytics by providing accurate and timely web data. The engineer must be able to handle complex data collection challenges such as dynamic content and large-scale data extraction.

What You Will Do

• Design, develop, and maintain web scraping tools and automated data collection tools
• Monitor data collection processes for accuracy, efficiency, and potential errors
• Parse, clean, and transform raw data into structured formats suitable for analysis and storage
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver relevant datasets
• Implement strategies to overcome technical challenges related to data collection
• Document data collection workflows, tools, and processes for team use and knowledge sharing
• Stay updated with the latest mobile technologies, collection tools, and best practices

Basic Qualifications

• Strong programming skills in Python and/or JavaScript
• Proficiency with web frameworks and libraries such as Selenium, Puppeteer, Scrapy
• Solid understanding of web technologies including HTML, CSS, JavaScript, DOM, HTTP protocols
• Experience with data parsing techniques, regular expressions, and data cleaning
• Problem-solving skills and attention to details
• Ability to work independently and collaboratively in a team environment