Joel Perca
Joel Perca

Joel PercaPhD student · FGV EMAp · Visual Data Science Lab

I make long urban video searchable.

AI engineer and researcher in Rio de Janeiro. I work on vision-language models, agentic retrieval and visual analytics, then ship them as production software: Django, React, Docker and Kubernetes.

Street intersection video frame from UrbanClipAtlas with a dark SUV and a man on a bike tracked by labelled boxes and trajectories

› Are there any significant conflict events involving cyclists and cars?

UrbanClipAtlas · CGF / EuroVis 2026matches09:1002:5508:45

How do you search hours of street video, and trust the answer?

My PhD at FGV EMAp continues the MSc thesis on visual analytics for long urban video. The work runs on three threads: retrieving the right clip, grounding every answer in what the cameras actually tracked, and measuring how people move through intersections.

UrbanClipAtlas: (A) chat panel answering a question about a cyclist and an SUV, (B) video frames with tracked objects, (C) timeline of related clips
UrbanClipAtlas: (A) ask in plain language, (B) see the answer on tracked objects, (C) jump to related clips.
  1. Retrieve

    Vision-language descriptions of short clips, indexed for retrieval-augmented question answering.

    UrbanClipAtlas · CGF 2026
  2. Ground

    A knowledge graph that aligns each answer with detected objects and trajectories, so it can be checked frame by frame.

    UrbanClipAtlas · CGF 2026
  3. Measure

    3D pedestrian pose, stature and walking speed recovered from fixed intersection cameras.

    MonoVsMulti3D · SIBGRAPI 2026

Publications

Peer-reviewed papers from the Visual Data Science Lab at FGV EMAp.

UrbanClipAtlas interface: chat panel with entity tooltips, video player with tracking overlays, related-clips timeline

Computer Graphics Forum, vol. 45, no. 3 (Proc. EuroVis 2026)

UrbanClipAtlas: A Visual Analytics Framework for Event and Scene Retrieval in Urban Videos

Joel Perca, Luis Sante Taipe, Juanpablo Heredia, João Rulff, Claudio Silva, Jorge Poco

First authorPublishedPresented at EuroVis 2026 — Nottingham, UK — June 2026

Ask questions of hours of street-intersection video and get answers grounded in what the cameras tracked.

› Abstract

A visual analytics system for exploring long urban videos recorded at street intersections. It segments recordings into clips, describes them with a vision-language model and indexes them for semantic retrieval, combining retrieval-augmented generation with taxonomy-aware entity extraction and video grounding. A knowledge graph aligns the language model output with detected objects and trajectories, so every answer can be visually grounded and verified. Evaluated on the StreetAware dataset through case studies on hazardous scenarios and pedestrian crossing dynamics.

Vision-language modelsRAGKnowledge graphsVideo grounding
Side-by-side pipelines: monocular learned (4 steps) vs multi-view geometric (4 steps) for 3D pedestrian pose

Proc. SIBGRAPI 2026 — Conference on Graphics, Patterns and Images

Comparing Monocular and Multi-View 3D Pedestrian Reconstruction Strategies for Urban Intersection Sensing

Kauan Mariani Ferreira, Matheus Fillype Ferreira de Carvalho, Joel Perca, João Rulff, Jorge Poco

Co-authorAccepted · In print

Monocular vs. multi-view 3D pedestrian reconstruction at intersections, compared without 3D ground truth.

› Abstract

Compares a monocular learned pipeline (text-prompted segmentation, tracking and learned 3D body estimation) with a calibrated multi-view geometric pipeline (2D pose, tracking, cross-camera association and triangulation) for deriving pedestrian motion descriptors at urban intersections. Without 3D ground truth, it evaluates coverage, anthropometric plausibility, walking-speed distributions, compute cost and failure modes, and gives practical guidance on when to use each.

3D pose estimationMulti-view triangulationUrban sensing
STRive interface: control panel, cluster scatterplot, US map, attribute and heatmap views, plus an LLM explanation panel

Computers & Graphics (Proc. SIBGRAPI 2025)

STRive: An association rule-based system for the exploration of spatiotemporal categorical data

Mauro Diaz, Luis Sante Taipe, Joel Perca, João Da Silva, Nivan Ferreira, Jorge Poco

Co-author (visualization platform)Published

Mines and clusters association rules in spatiotemporal data, explored through coordinated map and heatmap views.

› Abstract

A system for mining and exploring association rules over spatiotemporal categorical data. It pairs rule generation and rule clustering with an interactive interface offering two analysis modes — one at the cluster level, one at the individual rule level — connected through coordinated views. Demonstrated through case studies on fatal vehicle accidents and urban crime.

Association rule miningSpatiotemporal dataD3.js
Plus 2 IEEE VAST Challenge 2026 entries

Projects

Tools and platforms I built or contributed to, with code you can read.

Trayci popover under the system tray showing Antigravity, Claude and Codex quota meters, with the Claude detail pane

Developer tool · Author

Trayci

A local-first tray app that shows Claude Code, Codex and Antigravity quota usage and reset times, one click away.

  • Reuses each provider CLI's existing sign-in and never stores credentials.
  • Per-window meters, reset countdowns and opt-in alerts at 50/85/90%.
  • Ships .deb, AppImage and Windows installers from CI on every tag.
Tauri 2RustReactTypeScript
fuckpdf watermark tool: file thumbnail, live preview of page 1 with a diagonal watermark, and an options panel

Web app · Author

fuckpdf

Twelve PDF tools that run entirely in the browser on WebAssembly: no upload, no account, no telemetry.

  • Merge, split, rotate, watermark, crop, page numbers, JPG↔PDF and more.
  • Zero egress is enforced: a CSP with connect-src 'self' plus a Playwright test that fails the build on any third-party request.
  • Static assets only; engine chunks lazy-load, shell JS under 200 KB gzip.
TypeScriptReactPDFium (Wasm)Cloudflare
Podchy architecture: browser editor syncs over WebSocket to Django Channels, which spawns Kubernetes executor pods that stream output back

Platform · Co-author, team of 4

Podchy

Code as a service: shared workspaces with a live editor that runs your code in isolated Kubernetes pods.

  • Monaco editor with live collaboration over WebSockets (Django Channels).
  • Run executes the workspace inside a Kubernetes pod via the Python client and streams output to a console.
  • Ships Kubernetes manifests (API, web, ingress) and a minikube Makefile.
Django REST FrameworkDjango ChannelsKubernetesReactTypeScript
estela architecture: CLI uploads a project, the API builds images and creates Kubernetes jobs that stream spider data through Kafka into storage

Open source · Contributor

estela

Contributor to Bitmaker's open-source elastic web-scraping cluster, which runs Scrapy spiders as Kubernetes jobs.

  • 24 commits and 18 merged pull requests between 2022 and 2024, plus a fix in estela-cli.
  • Web UI: spider and project pages, activity feed, deploy views, job and cron-job details.
  • API: password change and reset, failed-job reports, project ownership transfer.
Django REST FrameworkCeleryReactKubernetesKafka

Experience

Research at FGV EMAp, preceded by engineering work in Peru.

Mar 2026 — Present

PhD in Applied Mathematics and Data Science

Fundação Getulio Vargas (FGV), EMAp

Visual Data Science Lab: urban video understanding, vision-language models and visual analytics.

Mar 2025 — Jul 2026

MSc in Applied Mathematics and Data Science

Fundação Getulio Vargas (FGV), EMAp

Visual Analytics for Long Urban Video Understanding

Oct 2024 — Mar 2025

Tech Lead · Grupo CEU Perú

Lima, PE

Led the digital transformation area: project delivery, support and evolution of CRM/ERP, automation, and microservices-based architecture.

  • Technical leadership in automations (conversational chatbot for WhatsApp support).
  • Infrastructure and architecture management (website, LMS, CRM, ERP, automations).
Jan 2024 — Dec 2024

RPA Developer · NTT Data Europe & Latam

Trujillo/Arequipa, PE

Process automation with Microsoft Power Platform and SAP iRPA; supported apps built with Power Apps/Dataverse and flows in Power Automate.

  • Business process automation (no/low-code).
  • Internal support and training on tools.
Full timeline

Let's talk

Research collaborations, engineering work, or a question about the papers.