Anbuselvan Annamalai anburocky3

How to Deep-Clone a Website (Including Lazy-Loaded Images)

When trying to clone or archive a modern web design, standard scraping tools often fail to capture images. This happens because modern frontend frameworks use lazy-loading techniques, storing image URLs in custom attributes like data-background or data-src instead of standard <img src="..."> tags.

Tools like wget only look for standard src attributes and will skip these lazy-loaded assets entirely.

This guide outlines a workaround using mitmproxy to intercept the HTML response and inject hidden image tags, tricking wget into downloading all lazy-loaded assets so the site works perfectly offline.

Prerequisites

fetch("http://ideunom.ac.in/mcq/question.php?OXBaVGsvT29RYWNPK2p5NUJJZUFpZz09", {
  "headers": {
    "accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7",
    "accept-language": "en-IN,en;q=0.9,kn;q=0.8,en-GB;q=0.7,ta;q=0.6",
    "upgrade-insecure-requests": "1"
  },
  "referrer": "http://ideunom.ac.in/mcq/questionpaper_pg.php?SjlTTkxLNDJ3bnF6TVdzWU9QQXdZUWhoR1Y0M0tVUkhyd2tNelNDeVFTRUIyVDlSU2wvZmJtS2ZLckx2RFBsZnovci90ZGdOcWl4dVBmRFcvbmNMNjZudW1Ud1ZLMVJGVzlOSUVBMWVlbkk9",
  "referrerPolicy": "strict-origin-when-cross-origin",
  "body": null,

fetch("http://ideunom.ac.in/mcq/questionpaper_pg.php?SjlTTkxLNDJ3bnF6TVdzWU9QQXdZYUNBeExGK0M1UVUyY1pldExmR093bTA0cTNHUEpSVnNWbysvRzI2L2lid01LK1RGVDgyeUlzM3lWdlllRUJHWFUzL0JyQ2lhcXpHL3JiR2RqZVlwb0E9", {
  "headers": {
    "accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7",
    "accept-language": "en-IN,en;q=0.9,kn;q=0.8,en-GB;q=0.7,ta;q=0.6",
    "upgrade-insecure-requests": "1"
  },
  "referrer": "http://ideunom.ac.in/mcq/question.php?OXBaVGsvT29RYWNPK2p5NUJJZUFpZz09",
  "referrerPolicy": "strict-origin-when-cross-origin",
  "body": null,

fetch("http://ideunom.ac.in/mcq/questionpaper_pg.php?SjlTTkxLNDJ3bnF6TVdzWU9QQXdZUkpFSmhOSkNrVGdWTzlNMGNDMHhWRDNrZEExUHh2Sk1LQlBUU1NpbnRtNjVIN1RNWnQrTVVqWks3M1d3ZWplSUw2NStpY1hyeU1VQTlmOGZ1aTJaTlE9", {
  "headers": {
    "accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7",
    "accept-language": "en-IN,en;q=0.9,kn;q=0.8,en-GB;q=0.7,ta;q=0.6",
    "upgrade-insecure-requests": "1"
  },
  "referrer": "http://ideunom.ac.in/mcq/question.php?OXBaVGsvT29RYWNPK2p5NUJJZUFpZz09",
  "referrerPolicy": "strict-origin-when-cross-origin",
  "body": null,

Reserved username list

This is the list of reserved usernames (pre-defined list of special banned and reserved keywords in names, such as "root", "www", "admin"). When we create a public system where users can choose a login name or a sub-domain name, we use this list to define which user names can not be used. The login authentication software verifies if the username is in this black list in the register validation process. Some reserved keywords here are specific for our service (Postbit) and other are generic black listed and reserved names that we use for all other services with login and usernames. Some websites forbid any generic names, short names (forbidden number of characters like usersnames with 1 or 2 characters) or also create lists of super famous people and companies so those logins can be reserved for future use. We allow only valid characters in the username that for us are letters, numbers, underline "_" and minus "-" (if it is in the middle of the username). We don't allow dot "." becaus

Important commands in Development

change the directory (cd)

cd path

folder-1 > folder-2

For example: Navigate from: folder-1 to folder-2

TailwindCss-Vite

Create project using the below commands.

npm create vite@latest my-project-name
> Vanilla
> JavaScript

Project Title

[Short Project Description]

	I'm exploring an app idea and I need your help to validate and improve it. I want you to take me through a structured 7-step process. At each step, ask me thoughtful questions and provide examples if needed. Guide me to produce actionable insights. The goal is to make sure I’m solving a real, painful problem and have a clear, feasible path to build and launch.

	Here’s the 7-step process I want you to walk me through:

	Step 1: Reverse Engineer the Idea to the Core Problem

	Help me deconstruct my app idea backwards to identify the core problem it solves.
	Ask questions like:
	“What result does this app create?”,
	“What’s hard or frustrating about achieving that result today?”,

	import { Country, State, City } from 'country-state-city';
	import { ICountry, IState, ICity } from 'country-state-city'

	const App = () => {
	const [country, setCountry] = useState(Country.getAllCountries())
	const [countryState, setCountryState] = useState<IState[]>([])
	const [city, setCity] = useState<ICity[]>([])

	useEffect(() => {
	setCountryState(State.getStatesOfCountry(data.country));