Skip to content
View PSheon's full-sized avatar

Organizations

@Syncrobotic

Block or report PSheon

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
PSheon/README.md
See · Think · Act — computer vision · multi-agent · LLM · edge

typing intro

followers

Hi there 👋

I'm Paul. I build machines that see and agents that act, and I like to own the whole path: the perception model on the edge device, the tracks and events it produces, and the agents that decide what to do with them.

  • 👁 Computer vision — multi-task perception networks, teacher / student distillation, ONNX / TensorRT on Jetson
  • 🤝 Multi-agent systems — orchestrator / worker designs, MCP tool contracts, edge-and-cloud split
  • 🧠 LLM — multimodal document understanding, structured output, VLMs on trigger rather than on every frame
  • Edge — RTSP ingest, GStreamer, WebRTC, Rust and Kotlin Multiplatform where Python is too slow
  • 📍 Kaohsiung, Taiwan · building at Syncrobotic

🔭 What I'm building

HydraNet — one camera, one model, everything in metres

HydraNet demo: detections and tracks on the left, the metric 3D scene with live dwell field on the right

Left: detections and tracks with a staff / customer verdict. Right: the same moment in metres, with the live dwell field on the floor.

  • One ~8M-parameter network, one forward pass. A shared RegNetX-800MF + BiFPN trunk carrying detection (person, bag, device, boxed_stock), pose (17 keypoints decoded inside the boxes) and terrain segmentation (floor, wall, column, fixture, person).
  • Teachers once, student every frame. SAM 3, Grounding DINO, Depth-Anything V2 and ViTPose run once per camera to label and to fit the scene geometry. Anything constant on a fixed camera is cached, never learned. Only what changes frame to frame spends the GPU.
  • Tracks in metres, not pixels. Boxes become floor positions through the cached geometry, so dwell, paths and queues come out in real units. Exported to ONNX / TensorRT for Jetson Orin, budgeted at 96 streams × 5 fps.

🧠 LLM

PDF2Markdown — multimodal LLM transcription of PDFs and images into clean Markdown: tables, formulas and diagrams preserved. Gemini-powered, model-swappable.

In HydraNet the VLM is a trigger, not a per-frame cost: rules and a tiny temporal model raise events, the VLM explains them.

🤝 Multi-Agent

Omnie agent orchestrator — an orchestrator / worker design split across edge and cloud: perception workers stay on the device next to the camera, planning and retrieval run where the big models live, MCP defines the tool contract between them.

Private for now. Architecture notes coming.

👁 Computer Vision

HydraNet — the multi-task perception network above, plus the commissioning pipeline (syncai_bev3d) that turns one static plate into a metric 3D scene, walkable floor, shelf ROIs and false-positive polygons per camera.

⚡ Edge

RtspRecorder — multi-stream RTSP recording in Rust: auto-segment, reconnect, cross-day schedules, MKV → MP4, upload to GCS.

KmpWebRTC — Kotlin Multiplatform WebRTC SDK with HTTP signaling and per-direction media control, zero WebRTC boilerplate.

🧰 Stack

VisionPyTorch ONNX TensorRT %C2%B7 Jetson OpenCV Hugging Face Python
LLM / AgentsClaude Gemini Ollama LangGraph MCP
Edge / InfraROS GStreamer WebRTC Kotlin Multiplatform Rust Solidity Docker PostgreSQL
AlsoTypeScript React Next.js

📈 Stats

PSheon | GitHub Stats   PSheon | Streak

PSheon | Contributions in the last 12 months, weekly

🤝 Find me

X LinkedIn Email

Pinned Loading

  1. Syncrobotic/SyncAI-Lib-HydraNet Syncrobotic/SyncAI-Lib-HydraNet Public

    Multi-task perception network for quadruped robots: traversability segmentation, terrain classification and anchor-free object detection in one PyTorch forward pass, exported to ONNX/TensorRT for J…

    Python 1

  2. PDF2Markdown PDF2Markdown Public

    Convert pdf\image\tables to Markdown. powered by Gemini.

    Python 1 1

  3. imageTool imageTool Public

    📷 影像編輯、壓縮工具

    JavaScript 1 1

  4. video-to-frames video-to-frames Public

    🎬 影片分割 + 🏃圖片肢體偵測

    TypeScript