Stellenangebot: Data Extraction & Pipeline Engineer (m/f/d) bei RE-Managers GmbH
Das Wichtigste im Überblick
Besondere Merkmale
Arbeitsort
Bad Grönenbach, AllgäuAngebotsart
ArbeitAnstellungsart
Vollzeit, Teilzeit (Vormittag, Nachmittag, Abend)Befristung
unbefristetBeginn
ab sofortBerufsbezeichnung
- Informatiker/in
- Software-Architect
Stellenbeschreibung
Job Title: Data Extraction & Pipeline Engineer (m/f/d) – Web Scraping & Market
Intelligence
Reference ID: IRIS-KHI-DATA-04
Location: Karachi Hub, Pakistan (DHA Phase 1 / Phase 2)
Contract Type: Full-time
Organization: IRIS – Institut für Resilienz, Innovation und Nachhaltigkeit
Application Channel: (Subject: Application IRIS-KHI-DATA-04 – [Your Name])
About the Organization
The IRIS – Institut für Resilienz, Innovation und Nachhaltigkeit develops intelligent data systems to observe, evaluate, and forecast market and sustainability developments across Europe. Our data pipelines extract and synthesize complex public, municipal, and real estate market indices into unified analytical models.
Role Overview
We are seeking an experienced Backend & Data Extraction Engineer to design, deploy, and monitor scalable web crawlers, data scrapers, and data ingestion pipelines handling diverse, unstructured web sources.
Key Responsibilities
- Architect and maintain robust scraping and crawling pipelines targeting property portals, public registers, municipal gazettes, and economic data sources.
- Implement parsing, data normalization, deduplication, and quality-validation routines for incoming raw data.
- Manage proxy rotation, anti-bot mechanisms, rate limiting, and headless browser workflows.
- Store and organize structured information using PostgreSQL, Redis, and document stores.
- Package data services into Docker containers and interface them with internal analytics engines via REST/GraphQL APIs.
Requirements & Qualifications
- Bachelor’s Degree in Computer Science, Software Engineering, or Information Technology (e.g., FAST-NUCES, NED University, or equivalent).
- Hands-on experience developing web scraping frameworks in Python: Scrapy, Playwright, Selenium, BeautifulSoup, or Puppeteer.
- Practical knowledge of relational (PostgreSQL) and NoSQL/caching databases (Redis, MongoDB).
- Experience with Linux environments, Docker, and Git.
- Structured problem-solving mindset, persistence with complex web structures, and solid English skills.
What We Offer & Career Pathways
- Competitive Package: Excellent compensation package aligned with regional developer salaries.
- Modern Workspace: Air-conditioned, reliable office in DHA Phase 1/2 with generator backup.
- Local Leadership Path: Opportunities to scale into Engineering Lead / Data Operations Manager as the Karachi hub grows, supported by ongoing technical mentorship and European project workflows.
- The International Research Track (§ 18d AufenthG): Top-performing engineers with consistent code quality and reliability over 3–6 months can transition to our research development institute in Germany under the § 18d researcher framework, complete with full visa sponsorship, relocation assistance, and housing / accommodation support.
How to Apply: Send your CV by E-Mail: jobs-scraping@iris-institut.info
Arbeitsorte
Unternehmensdarstellung: RE-Managers GmbH
In diesem Dokument befinden sich aus Sicherheitsgründen keine Kontaktdaten des Arbeitgebers. Wenn Sie diese sehen möchten, lösen Sie bitte die Sicherheitsfrage und laden Sie das PDF erneut.