Inafana – Building Digital Solutions That Work for You

Real-Time Web Scraper Widget for TruthSocial Posts

Inafana > Custom Software > Real-Time Web Scraper Widget for TruthSocial Posts

Real-Time Web Scraper Widget for TruthSocial Posts

The client needed a web-based dashboard to fetch and manage financial data from the QuickBooks Online API. The tool needed to offer secure login access, filter and manipulate financial data (such as multiplying columns by user-defined values), and generate downloadable Excel files and PDF statements/activities.

  • Client: Pat Burke
  • Country: United States
  • Project Name: Real-Time TruthSocial Post Scraper & Dashboard
  • Deployment: Cloud-hosted
  • Target Account: @realdonaldtrump on TruthSocial

Technologies Used:

  • icon Backend: Python (FastAPI or Flask), Scrapy or Playwright for scraping
  • icon Frontend: React.js with TailwindCSS for responsive design
  • icon Authentication: Firebase Auth or JWT-based login system
  • icon Real-Time Updates: WebSockets or Server-Sent Events (SSE)
  • icon Cloud Deployment: Render, Heroku, or AWS EC2/S3
  • icon Data Handling: Redis (for real-time messaging) and MongoDB/PostgreSQL for storage
  • icon Optional Features: Font/size/color customization stored per user profile

Key Features:

  1. Real-Time Scraper
    • Continuous monitoring of TruthSocial profile (@realdonaldtrump)
    • Uses headless browser automation (via Playwright) or API fallback to extract the latest posts with near-zero delay
    • Post content, media links, and timestamps captured in structured format
  2. Widget Development
    • A lightweight embeddable widget that displays scraped posts in:
      • Custom fonts
      • Adjustable colors
      • Variable text sizes
    • Auto-refreshes as new posts are detected without user input
  3. Web-Based Dashboard
    • Secure login for authorized users
    • Dashboard layout with:
      • Live post feed
      • Post history viewer
      • Font and color setting panel
    • Admin-level access to control scraping frequency, styling defaults, and refresh behavior
  4. Cloud Deployment
    • Entire solution deployed to a cloud platform for 24/7 uptime
    • Backend and frontend hosted separately for scalability
    • TLS encryption for secure access
    • Cron job or scheduler used to maintain scraping uptime

Our Solution:

  • User Authentication: Developed a secure login system using JWT, ensuring only authorized users could access the data.
  • API Integration: Integrated with QuickBooks API to fetch real-time account data from the QuickBooks Account Entity.
  • Data Manipulation UI:
    • Download the current account data
    • Filter columns and rows
    • Multiply a selected column by a user-defined multiplier
    • Generate new columns with calculated values
  • Export Options:
    • Export modified data to Excel format
    • Generate and download PDF Statements and Activity Logs using jsPDF
  • Design: Built with a clean and modern UI for ease of use, ensuring responsiveness across devices.

Outcome & Benefits:

  • Delivered a real-time scraping tool with <3-second latency on new posts
  • Enabled secure access and display customization for internal and external use
  • Allowed the client to track and display high-profile social media posts without delay
  • Optimized for desktop and mobile views

Our Similar Projects

Asset & Equipment Tracker

Ecommerce Competitor Price Scanner and Scraper