Junior Python Developer focusing on web scraping and data extraction at Beemôn. Collaborating with the engineering team to develop and maintain data collection scripts.
Responsibilities
Develop and maintain scripts and crawlers for automated data collection.
Create spiders using Scrapy, Requests and BeautifulSoup (bs4).
Automate navigation on dynamic pages using Selenium.
Assist with configuring and using proxies and VPNs for data collection.
Work with queues and asynchronous processing using Celery, Redis and RabbitMQ.
Integrate collected data with internal systems built with Django.
Store and manipulate data using PostgreSQL.
Monitor crawler runs and identify failures or inconsistencies in data collection.
Identify and handle common scraping blocks, such as rate limiting, incorrect headers, or session issues.
Requirements
Knowledge of Python.
Basic understanding of HTTP, HTML and REST APIs.
Basic knowledge of web scraping.
Familiarity with Git and version control workflows.
Basic experience working in teams using agile methodologies.
Basic knowledge of SQL.
Benefits
Education assistance
Career development plan
Fuel allowance
Wellness
Quick Massage
Meal allowance
Health insurance
Flexible schedule
Job title
Junior Python Developer – Web Scraping, Data Extraction
Senior Technical Architect at SiXworks leading technology design and architecture while mentoring teams. Collaborating with stakeholders to deliver secure digital technology solutions in highly secure environments.
Lead technology initiatives in applications development and adopt DevOps practices at Citi. Focused on high - quality, resilient software solutions in the payments domain.
Java Microservices Developer responsible for Microservices applications development and support using Java at Citi. Involve in AGILE methodologies and collaborate with global teams.
Applications Development Senior Programmer Analyst contributing to software development and applications at Citi. Involves collaboration with technology teams and complex problem - solving in financial services.
Java/Scala/Axiom Developer supporting Morgan Stanley's Regulatory Reporting group. Collaborating on data sourcing, integration, and application development within Finance Technology.
Technical Specialist leading engineering and architecture decisions at Junto Seguros. Delivering scalable solutions for insurance products with a focus on performance and security.
Technical ERP Developer maintaining legacy .NET applications and PeopleSoft components at Stefanini. Ensuring the availability and correct operation of critical systems.
Senior .NET Developer tasked with building scalable systems for a leading global Defence and Aerospace company. Joining an engineering squad to enhance technical robustness and delivery capacity.
Senior Software Engineer utilizing Typescript, Expo, React, Node.js, and GraphQL at Unloan. Delivering high - performance platforms that redefine digital lending and improve user experiences.
Principal Engineer at Saviynt developing AI - powered identity solutions. Leading enterprise cloud solution architecture and collaborating with teams to enhance security and efficiency.