Book a call: https://calendly.com/itshassanaziz/discuss-a-project
==== ==== ====
WHAT'S THIS VIDEO ABOUT?
I walk through a scraper I built that pulls job postings from Reddit subreddits like r/remotepython, since a lot of solid remote gigs never make it to Indeed or LinkedIn. It uses a headful Playwright browser to get past bot detection, then runs everything through Gemma 4 to filter out spam and pull out the real opportunities. I also show the script that lines up the qualified posts so I can click through and apply one after another without digging through Reddit manually.
Like, subscribe, & leave me a comment if you have a specific request. Thanks.
==== ==== ====
TIMESTAMPS
00:00 Why Reddit Has Hidden Job Gems
00:35 The AI Scraper & Applier Idea
01:02 Workflow Architecture Overview
01:07 Step 1: Scraping Reddit Posts
02:16 Step 2: Filtering Posts With AI
03:00 Using a Cheap Model (Gemma 4)
03:27 Classification Prompt & JSON Schema
03:55 Using Comments to Catch Scams
04:58 Step 3: Applying to Jobs
06:21 Ideas to Expand the Workflow
06:54 Workflow Recap
07:34 Skipping Saturated Job Boards
WATCH THESE NEXT
https://www.youtube.com/watch?v=05ZS4w84Yfk
https://www.youtube.com/watch?v=OmV52jkTnjE
https://www.youtube.com/watch?v=Hz5QCSGzVZw
==== ==== ====
WHY LISTEN TO ME?
Hey everyone, I'm Hassan. I run an AI/Automation and Software Development agency at hassandev.me. I've built custom workflows that save clients 20+ hours every week. I've helped businesses solve CRM issues that directly led to an increase of $430k CAD in quotations. I've scaled platforms to 100,000 users and beyond. I also enjoy making content and sharing what I learn with the world. I love to yap on YouTube, as you can see. I'm very active here, and on X, so if you want to reach out to me, leave a comment or DM me on X.
MY LINKS
Website: https://www.hassandev.me
Portfolio: https://www.hassandev.me/work
YouTube: https://www.youtube.com/@itshassanaziz?sub_confirmation=1
My Book: https://www.hassandev.me/designing-websites
X / Twitter: https://x.com/intent/user?screen_name=nothassanaziz
Instagram: https://www.instagram.com/hassansdev/
LinkedIn: https://www.linkedin.com/in/hassan-aziz-web
Auto-generated transcript if you don't already know this there's a lot of high quality jobs that get posted on reddit every single day on all of these different subreddits that don't necessarily get posted on the popular job boards like indeed and linkedin and all the other places that most people are applying to so i'm at the r slash remote python subreddit and there's like like this is a subreddit this is a community where people post jobs all the time and there's like 20 other popular subreddits just like this one where people post remote jobs and freelance tasks and all that the only problem is there's a lot of stuff to go over right there's so many subreddits that you need to keep track of you need to check every day for new jobs and stuff so to fix all that we're going to build a little scraper and a plier using ai basically to do it all for us and i've actually built the entire thing already and i'm going to post this on my github and stuff and you can just go and you know clone this on your machine and just start using it yourself but for the rest of this video i want to go over the um architecture the workflow that i actually built over here and how it actually works right so there's like four steps over here the first one is to actually scrape the post so let me just show you how that works so in order to build a scraper that can actually bypass reddit's bot detection what you need is you need a head full browser instance and you need to use some sort of an automation tool like playwright or puppeteer or something i just use playwright the reason we let me just change the font over here the reason we're using a head full browser instance is because even though headless browsers are much more convenient and easier to use for these kinds of tasks they are far more likely to get detected as well so use a head full browser instance use something like playwright to build this entire scraper go into your coding agent tell it to build a scraper for a subreddit or a Reddit post, give it the HTML source of that entire page, and then just ask it to create a head full browser instance that can scrape that entire page And also try to make sure that you using a logged in account as well Because if you anonymous that triggers the bot detection mechanisms on Reddit as well. So if you're if you have a logged in account, you are far more likely to succeed in scraping these posts without necessarily being detected as a bot or a script, right? Once you've built that you need to, you know, filter and enrich all of these posts because if we go over here to this subreddit yeah most of these are you know job posts but some of them can also be jobs that you're not qualified for or jobs that are in an industry that you don't work in or all these other things right some of them can even be unrelated posts like these right that aren't even jobs there are just some guy asking a question that you don't care about so you need to be able to filter out all of these different kinds of jobs and AI is best used over here because LLMs, large language models, they, you know, excel at these kind of tasks, you know, understanding language, understanding human words and stuff. The neat thing is you can use a very cheap model in this step as well, because this is like, you're not asking it to, you know, perform some really complex reasoning task, right? You're just asking it to classify a short little Reddit post over here. So you can use a very cheap, very small model for this as well. I myself am just using Gamma 4 from Google. It's a very small model. It's like, I don't know, 20, 30 billion parameters, very small model, and it gets the job done very, very nicely. As for the prompt I'm using, this isn't anything complicated. I just ask it to evaluate if this post is a real job or a hiring opportunity. And of course, return structured analysis like a structured JSON schema so that I can actually programmatically use this in the next part of my automation workflow, right? And I'll just pass in the post body, the title, the author. Author isn necessarily useful over here but at the very least you going to want to pass in the subreddit the title the post body and maybe the first five or ten comments as well because sometimes what happens is you can have a very nice post over here but it can have some issues like it maybe it a scam or maybe the author is a scammer or you know the post is completely ai generated or it's not a real opportunity and people in the comments can sometimes figure that out and just you know write that in the comments. So if you pass those comments over here in the prompt, then oftentimes you can catch bad posts early on that wouldn't necessarily be considered bad posts if you just passed in the post body and the title, right? So just something to consider over there. But yeah, once you've done that, once you've done step two, which is to use AI to classify posts, extract payments and compensation and filter out spam and all the other stuff. Once you've done all that, you should have a big list of jobs that you can apply to that are high quality, that are, you know, uniquely personalized to you and your skills. And they're actually real jobs that aren't necessarily a scam or whatever. You'll have a big list of jobs like that. The next thing you need to do is to actually apply to them, right? Now, both of these steps can just be the exact same thing. At least in my automation workflow, they are the exact same thing. What I've done is, maybe if i can show you over here so i've got a script over here called apply to jobs right and what it does is it's going to pick any of the you know qualified jobs over here that we've filtered out in step two right here in step two it's going to give me all the details about that job and the link to that job and i can just go over to that link and apply in whatever manner is best for that job right sometimes you need to apply on a third-party website sometimes you can just post or comment on that post or sometimes you can just DM the author of that post and you know talk to him directly Whatever it is I can just go over to this link and manually do it right So that in a nutshell is the entire workflow basically And you know once I done applying to this job I can just press enter and it take me to the next job and then i can apply to that and so on and so forth right and the reason i even have this little script over here is so i don have to go and you know manually find all of the qualified job posts and then apply to them one by one i can just run this script it'll give me all the links i need to go to i'll just quickly go to those links post in my application move to the next job and so on right super easy super simple workflow and so that's basically what I've built. But obviously, you can expand this to add more features that you need as well, right? So one thing you could probably do is when you're applying to the jobs, you could probably have AI write like something like, I don't know, personalized application or resume for you. You could probably have AI write something like that for every single qualified job post. And then you might be able to use that same document or, you know, resume or whatever when you're applying to that job. And of course, you can add a couple more features as well. It's entirely up to you. But the basic workflow is very simple. You build a scraper, you have a list of target subreddits. Like I'm hiring, not hiring, but I'm scraping all of these subreddits, for hire, job it, hiring, and all the other ones. So I've got like eight subreddits where people post jobs and I'm scraping all of them. Then I use Gemma 4 to filter and enrich the, you know, posts in that subreddit and identify all of the jobs. Then I simply apply to the jobs using this script over here that eliminates all of the work where I have to, you know, like go to my browser, find a post and all that. I don't need to do any of that. I just click the link and I apply. And if you do this, you can pretty much skip all of the, you know, oversaturated job boards like indeed or linkedin or remote i o and all that and you can find jobs over here on this platform where you know not a lot of people are applying so this isn't as saturated as all the other job boards are so yeah hope that helps hope you found something helpful in here that's gonna be all for this video see ya