Photo

Patt PHURTIVILAI

Hello! I’m Patt Phurtivilai, an enthusiastic AI research assistant currently pursuing an Engineering degree with a major in Computer Science at The University of Hong Kong. My passion lies in virtual reality and immersive technologies, and I aspire to create the OASIS—a revolutionary virtual universe inspired by Ernest Cline's Ready Player One.

With hands-on experience in computer vision and graphics, 3D reconstruction, and multimodal chatbot systems, I thrive at the intersection of technology and creativity. My work reflects a deep commitment to advancing artificial intelligence and crafting engaging digital experiences.

I invite you to explore my projects and collaborations as we embark on this journey to shape the future of virtual worlds together. Let’s connect and innovate!

   /      /   pattgene [at] connect (dot) hku (dot) hk

Download CV



Academic Publications

PHURTIVILAI PATT, Huang Leyang, Yinqiang Zhang, Lei Yang,The University of Hong Kong
DensifyBeforehand: LiDAR-assisted Content-aware Densification for Efficient and Quality 3D Gaussian Splatting
Under Review

This paper addresses limitations in 3D Gaussian Splatting (3DGS) methods, specifically their dependency on adaptive density control, which can lead to artifacts and inefficiencies. We propose a "densify beforehand" approach that combines sparse LiDAR data with monocular depth estimation to enhance scene initialization. Our ROI-aware sampling prioritizes important regions, creating a dense point cloud that improves visual fidelity and efficiency. This method reduces redundancy in Gaussians, allowing for better quality with lower resource consumption and training time, validated through comparisons on four new datasets.

[Page]
Patt Phurtivilai, Lio Qing, Ryan Chan The University of Hong Kong
3D Digital Twins for MakerSpace
Presented at 9th International Symposium on Academic Makerspaces (ISAM2025)
Leyang Huang, Patt Phurtivilai, Xiang Chen, Syed Nafis Ishrak, Jose Alberto Espino Pitti, The University of Hong Kong
Fostering AI Makerspace: A Journey through Introductory Hands-On Workshop
Presented at 8th International Symposium on Academic Makerspaces (ISAM2024)


Recent Projects

InnoGrow: Non-Toxic Weed Killing Box

  • Developed INNOGROW: a non-toxic laser weed control solution for sustainable farming in Asia.
  • Trained a weed detection model with a custom dataset; integrated with NCNN on Raspberry Pi for a compact design.
  • Controlled laser shooting with a servo using an ESP32 board.
[Video] [Code]
Digital Twins: 3D Gaussain Splatting Reconstruction

  • Collaborating with MTR, building a digital twins for tunnels.
  • Lidar Scaning and processing.
  • 3D Gaussian Splatting using Lidar Slam initialization.
Multimodal AI Assistant: RAG system for both image and text

  • Developed a multimodal RAG system for processing and generating text and images.
  • Created a data preprocessing pipeline with layout detection and Azure OCR for content extraction.
  • Designed a retrieval mechanism for interleaving text and images, enhancing traceability and accessibility.
[Video] [Code]
Grounding-Dino: zero shot training with real time camrea feed
participate in HKU innoshow2024

  • Developed a real-time object detection and tracking system from Grounding DINO and live feed.
  • Implemented keyword-based detection for continuous object tracking.
  • Showcased advanced computer vision techniques for dynamic mobile interaction.
[Video] [Code]
Azai Solution - CRM + Payment API Application
Winning the 1st prize for Cyberport CUPP 2023 micro funding

  • Developed AZAI, a smart CRM app for landlords in Thailand using React Native and TypeScript.
  • Integrated payment APIs and Firebase for efficient contract and property management.
  • Utilized Next.js for backend development, adding analytics features to improve landlord-resident interactions.
[Page] [Video]


Experience

Research Assistant @ CGVU Lab, HKU


  • Conducting independent research on an Object Tracking System, focusing on multi-camera association and effective triangulation techniques
  • Generating 3D synthetic motion data using Unreal Engine 5.

NVIDIA Student ambassadors


  • Collaborated with NVIDIA researchers to develop a paper on an endoscopic robot for visualizing and reconstructing human vessels using depth estimation models and SLAM reconstruction techniques.

Summer AI Research Assistant @ Innowing, HKU


  • Conducted individual research in computer graphics and 3D reconstruction, focusing on Gaussian Splatting for real-time rendering using Lidar, depth sensors, and SLAM technologies.
  • Developed a Multimodal Retrieval-Augmented Generation system by researching LLMs, OCR, and layout detection models, utilizing GPT-4.
  • Collaborated with UBC and Tsinghua University on research projects and hosted workshops on computer graphics, computer vision, and retrieval-augmented generation.

Part-time AI Research Assistan @ Innowing, HKU


  • Computer vision and graphics research team, exploring cutting-edge technologies in AI. Collaboration on a real work with MTR corporation, scaning tunnel and create digital twins for them.
  • Hosted workshops on computer vision, computer graphics, and large language models for participants from Hong Kong University.
  • Conducted research on large language models and retrieval-augmented generation (RAG), developing a local chatbot for university.

Founder and CEO of AZAI Solution, a self-startup funded by Cyberport.


  • Founded and served as CEO of AZAI, a fintech startup awarded a 100k HKD grant from Cyberport for innovative solutions.
  • Developed an Android application and website to help landlords in Thailand create contracts, manage payments, and oversee property management.
  • Designed AZAI as a CRM application utilizing payment APIs, providing data analytics services to facilitate interactions between landlords and residents.

Software Engineering & Data Analyst Summer Internship @ Risksis Technology Limited


  • Engaged in data retrieval, preprocessing, and model training using Keras, OpenCV, and Scikit-learn during a summer internship.
  • Developed a web application utilizing frontend frameworks, including an interface for 3D visualization with Unity.
  • Wrote scripts in C# and Python to meet project requirements and enhance functionality.