{"id":2186,"date":"2010-01-28T01:20:23","date_gmt":"2010-01-28T06:20:23","guid":{"rendered":"http:\/\/g33kinfo.com\/info\/?p=2186"},"modified":"2010-01-28T01:20:23","modified_gmt":"2010-01-28T06:20:23","slug":"faking-user-agent-with-wget","status":"publish","type":"post","link":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/","title":{"rendered":"Faking User Agent with Wget"},"content":{"rendered":"

Faking User Agent with Wget<\/strong><\/big>
\n\"\"
\nWritten by Steve Lake<\/a>
\nFrom http:\/\/www.raiden.net<\/a>
\nPosted on: Jan 27, 2010 at 07:49am
\nSection: Tutorials<\/a>
\nPrinter Friendly Version<\/a>
\nLegacy URL<\/a>
\n\"\" A good portion of the Linux community who are familiar with the command line are also very familiar with a powerful tool known as Wget. \u00a0It’s sort of an FTP\/web download program for grabbing files off the web. \u00a0Combined with other programs like screen, it’s invaluable for a wide number of things. \u00a0But I bet those of you who use it didn’t know that you cold also use it to fake the user agent information, did you? <\/p>\n

Well, you can, and the trick is amazingly simple, and yet both hugely practical, and life saving in some cases. \u00a0Case in point, there’s a couple sites I go to where I need to download some stuff, but the site prevents downloads, save with their own proprietary software, or a specific browser. \u00a0(Internet Explorer for example.)<\/p>\n

A simple way around this is to use Wget’s header information feature. \u00a0Browsers and many 3rd party programs use a system called “User Agent”, which is little more than a simple, short text string sent by the program to identify itself to the server. \u00a0Case in point, this is the user agent string for apt-get (Ubuntu APT-HTTP\/1.3) and this is the string for Firefox 3.5. (Mozilla\/5.0 (X11; U; OpenBSD i386; en-US; rv:1.9.1) Gecko\/20090702 Firefox\/3.5) \u00a0(A good list of most known user agent strings is available here<\/a>)<\/p>\n

To activate the user agent string in wget, you will need to type “-U” followed by the user agent string encapsulated in quotes. \u00a0Here’s an example using the Apple Quicktime 7.6.2 user agent (for those of you who like to download and watch Apple trailers):<\/p>\n

wget -U “QuickTime\/7.6.2 (qtver=7.6.2;os=Windows NT 5.1Service Pack 3)”<\/p>\n

After that, you simply include the rest of your command line, such as file to be downloaded, and any other pertinent information. \u00a0It’s surprising how few people actually know and use this trick. \u00a0But with more sites excluding browsing and\/or downloading by “unapproved” browsers or download agents, the user agent string is becoming an important part of thwarting those efforts, while continuing to maintain your freedom to choose what method you use to download or surf with.<\/p>\n

I hope this helps. And give it a try sometime on an otherwise difficult site. \u00a0You might be surprised at how useful it turns out to be.<\/p>\n","protected":false},"excerpt":{"rendered":"

Faking User Agent with Wget Written by Steve Lake From http:\/\/www.raiden.net Posted on: Jan 27, 2010 at 07:49am Section: Tutorials Printer Friendly Version Legacy URL A good portion of the Linux community who are familiar with the command line are also very familiar with a powerful tool known as Wget. \u00a0It’s sort of an FTP\/web… <\/p>\n

Read More<\/i><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[],"class_list":["post-2186","post","type-post","status-publish","format-standard","hentry","category-info"],"yoast_head":"\nFaking User Agent with Wget - Linux Shtuff<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Faking User Agent with Wget - Linux Shtuff\" \/>\n<meta property=\"og:description\" content=\"Faking User Agent with Wget Written by Steve Lake From http:\/\/www.raiden.net Posted on: Jan 27, 2010 at 07:49am Section: Tutorials Printer Friendly Version Legacy URL A good portion of the Linux community who are familiar with the command line are also very familiar with a powerful tool known as Wget. \u00a0It’s sort of an FTP\/web... Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/\" \/>\n<meta property=\"og:site_name\" content=\"Linux Shtuff\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/fb.me\/g33kinf0\" \/>\n<meta property=\"article:author\" content=\"https:\/\/fb.me\/g33kinf0\" \/>\n<meta property=\"article:published_time\" content=\"2010-01-28T06:20:23+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.raiden.net\/themes\/default\/images\/hdivider.jpg\" \/>\n<meta name=\"author\" content=\"g33kadmin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/drsinger1111\" \/>\n<meta name=\"twitter:site\" content=\"@drsinger1111\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/\"},\"author\":{\"name\":\"g33kadmin\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/#\\\/schema\\\/person\\\/c022e4c40b13ea1b678e6f020756f547\"},\"headline\":\"Faking User Agent with Wget\",\"datePublished\":\"2010-01-28T06:20:23+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/\"},\"wordCount\":415,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/#\\\/schema\\\/person\\\/c022e4c40b13ea1b678e6f020756f547\"},\"image\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.raiden.net\\\/themes\\\/default\\\/images\\\/hdivider.jpg\",\"articleSection\":[\"General Info\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/\",\"url\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/\",\"name\":\"Faking User Agent with Wget - Linux Shtuff\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.raiden.net\\\/themes\\\/default\\\/images\\\/hdivider.jpg\",\"datePublished\":\"2010-01-28T06:20:23+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#primaryimage\",\"url\":\"http:\\\/\\\/www.raiden.net\\\/themes\\\/default\\\/images\\\/hdivider.jpg\",\"contentUrl\":\"http:\\\/\\\/www.raiden.net\\\/themes\\\/default\\\/images\\\/hdivider.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/faking-user-agent-with-wget\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Faking User Agent with Wget\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/#website\",\"url\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/\",\"name\":\"Linux Shtuff\",\"description\":\"Because I have CRS Syndrome...\",\"publisher\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/#\\\/schema\\\/person\\\/c022e4c40b13ea1b678e6f020756f547\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/#\\\/schema\\\/person\\\/c022e4c40b13ea1b678e6f020756f547\",\"name\":\"g33kadmin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/minion-researchA.gif\",\"url\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/minion-researchA.gif\",\"contentUrl\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/minion-researchA.gif\",\"width\":512,\"height\":512,\"caption\":\"g33kadmin\"},\"logo\":{\"@id\":\"https:\\\/\\\/g33kinfo.com\\\/info\\\/wp-content\\\/uploads\\\/2022\\\/07\\\/minion-researchA.gif\"},\"description\":\"I am a g33k, Linux blogger, developer, student and Tech Writer for Liquidweb.com\\\/kb. My passion for all things tech drives my hunt for all the coolz. I often need a vacation after I get back from vacation....\",\"sameAs\":[\"https:\\\/\\\/thelinuxreport.com\",\"https:\\\/\\\/fb.me\\\/g33kinf0\",\"https:\\\/\\\/x.com\\\/https:\\\/\\\/twitter.com\\\/drsinger1111\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Faking User Agent with Wget - Linux Shtuff","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/","og_locale":"en_US","og_type":"article","og_title":"Faking User Agent with Wget - Linux Shtuff","og_description":"Faking User Agent with Wget Written by Steve Lake From http:\/\/www.raiden.net Posted on: Jan 27, 2010 at 07:49am Section: Tutorials Printer Friendly Version Legacy URL A good portion of the Linux community who are familiar with the command line are also very familiar with a powerful tool known as Wget. \u00a0It’s sort of an FTP\/web... Read More","og_url":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/","og_site_name":"Linux Shtuff","article_publisher":"https:\/\/fb.me\/g33kinf0","article_author":"https:\/\/fb.me\/g33kinf0","article_published_time":"2010-01-28T06:20:23+00:00","og_image":[{"url":"http:\/\/www.raiden.net\/themes\/default\/images\/hdivider.jpg","type":"","width":"","height":""}],"author":"g33kadmin","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/drsinger1111","twitter_site":"@drsinger1111","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#article","isPartOf":{"@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/"},"author":{"name":"g33kadmin","@id":"https:\/\/g33kinfo.com\/info\/#\/schema\/person\/c022e4c40b13ea1b678e6f020756f547"},"headline":"Faking User Agent with Wget","datePublished":"2010-01-28T06:20:23+00:00","mainEntityOfPage":{"@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/"},"wordCount":415,"commentCount":0,"publisher":{"@id":"https:\/\/g33kinfo.com\/info\/#\/schema\/person\/c022e4c40b13ea1b678e6f020756f547"},"image":{"@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#primaryimage"},"thumbnailUrl":"http:\/\/www.raiden.net\/themes\/default\/images\/hdivider.jpg","articleSection":["General Info"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/","url":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/","name":"Faking User Agent with Wget - Linux Shtuff","isPartOf":{"@id":"https:\/\/g33kinfo.com\/info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#primaryimage"},"image":{"@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#primaryimage"},"thumbnailUrl":"http:\/\/www.raiden.net\/themes\/default\/images\/hdivider.jpg","datePublished":"2010-01-28T06:20:23+00:00","breadcrumb":{"@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#primaryimage","url":"http:\/\/www.raiden.net\/themes\/default\/images\/hdivider.jpg","contentUrl":"http:\/\/www.raiden.net\/themes\/default\/images\/hdivider.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/g33kinfo.com\/info\/faking-user-agent-with-wget\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/g33kinfo.com\/info\/"},{"@type":"ListItem","position":2,"name":"Faking User Agent with Wget"}]},{"@type":"WebSite","@id":"https:\/\/g33kinfo.com\/info\/#website","url":"https:\/\/g33kinfo.com\/info\/","name":"Linux Shtuff","description":"Because I have CRS Syndrome...","publisher":{"@id":"https:\/\/g33kinfo.com\/info\/#\/schema\/person\/c022e4c40b13ea1b678e6f020756f547"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/g33kinfo.com\/info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/g33kinfo.com\/info\/#\/schema\/person\/c022e4c40b13ea1b678e6f020756f547","name":"g33kadmin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/g33kinfo.com\/info\/wp-content\/uploads\/2022\/07\/minion-researchA.gif","url":"https:\/\/g33kinfo.com\/info\/wp-content\/uploads\/2022\/07\/minion-researchA.gif","contentUrl":"https:\/\/g33kinfo.com\/info\/wp-content\/uploads\/2022\/07\/minion-researchA.gif","width":512,"height":512,"caption":"g33kadmin"},"logo":{"@id":"https:\/\/g33kinfo.com\/info\/wp-content\/uploads\/2022\/07\/minion-researchA.gif"},"description":"I am a g33k, Linux blogger, developer, student and Tech Writer for Liquidweb.com\/kb. My passion for all things tech drives my hunt for all the coolz. I often need a vacation after I get back from vacation....","sameAs":["https:\/\/thelinuxreport.com","https:\/\/fb.me\/g33kinf0","https:\/\/x.com\/https:\/\/twitter.com\/drsinger1111"]}]}},"_links":{"self":[{"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/posts\/2186","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/comments?post=2186"}],"version-history":[{"count":0,"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/posts\/2186\/revisions"}],"wp:attachment":[{"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/media?parent=2186"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/categories?post=2186"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/g33kinfo.com\/info\/wp-json\/wp\/v2\/tags?post=2186"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}