Skip to content

some URLs can't be archived #3

@yakticus

Description

@yakticus

It seems like certain URLs with query params can't be archived. Here's a recent list of examples. It might be worth cleaning up some of the bookmarks to remove unnecessary query params.

WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/17/opinion/a-party-to-the-russian-connection.html?smid=tw-share
WARNING:__main__:unable to archive url http://www.thestranger.com/slog/2017/01/20/24814797/why-neoliberalism-died-today-and-why-seattle-might-be-the-future-of-the-left
WARNING:__main__:unable to archive url http://www.politico.eu/article/sergei-lavrov-and-rex-tillerson-to-meet-thursday-russia-united-states/?wpisrc=nl_daily202&wpmm=1
WARNING:__main__:unable to archive url http://www.azcentral.com/story/news/arizona/politics/2015/07/12/donald-trump-talks-immigration-phoenix-visit/30041667/
WARNING:__main__:unable to archive url https://risestronger.org/resist
WARNING:__main__:unable to archive url https://thinkprogress.org/the-president-just-elevated-a-dangerous-anti-vaxxer-talking-point-d9eb18358e2e#.yzqn0xp3o
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/14/us/politics/Kellyanne-Conway-ivanka-trump-ethics.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=b-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/14/us/politics/flynn-russia-trump-resignation.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/13/us/politics/mar-a-lago-north-korea-trump.html?mabReward=A1&recp=2&version=readinglist&action=click&pgtype=Homepage&clickSource=story-heading&module=c-column-middle-span-region&region=c-column-middle-span-region&WT.nav=c-column-middle-span-region&_r=0
WARNING:__main__:unable to archive url https://www.apnews.com/418d4c32d280412aba4f64711950b4e3
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/13/business/the-gateway-pundit-trump.html?partner=rss&emc=rss&smid=tw-nytpolitics&smtyp=cur
WARNING:__main__:unable to archive url http://nymag.com/thecut/2017/02/all-the-stores-that-have-dropped-trump-lines.html?mid=twitter_nymag
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/09/us/politics/consumer-financial-protection-bureau-republicans.html?smid=tw-nytpolitics&smtyp=cur
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/12/us/politics/national-security-council-turmoil.html?_r=0&wpisrc=nl_daily202&wpmm=1
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/10/world/europe/bannon-vatican-julius-evola-fascism.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url https://apnews.com/1a21e67ad4a94bd59235f11460b42298/Trump-attacks-on-judiciary-raise-safety-concerns-for-judges
WARNING:__main__:unable to archive url https://www.nytimes.com/interactive/2017/02/11/us/politics/sean-spicer-white-house-press-briefing.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=b-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://web.archive.org/web/20161218160738/https://fop.net/CmsDocument/Doc/TrumpFirst100Days.pdf
WARNING:__main__:unable to archive url http://www.franken.senate.gov/files/letter/170117AlexanderLetter.pdf
WARNING:__main__:unable to archive url http://www.fiercebiotech.com/node/471731
WARNING:__main__:unable to archive url http://www.smithsonianmag.com/science-nature/vast-geological-challenges-building-border-wall-180962072/
WARNING:__main__:unable to archive url http://www.cleveland.com/court-justice/index.ssf/2017/02/cleveland_federal_judge_says_t.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/08/business/ivanka-trump-nordstrom-tj-maxx.html?smid=fb-nytimes&smtyp=cur&_r=5
WARNING:__main__:unable to archive url http://www.oregonlive.com/politics/index.ssf/2017/02/jeff_merkley_reads_coretta_scott_king_letter_about_jeff_sessions.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/04/us/politics/republicans-oil-gas-regulations.html?smprod=nytcore-iphone&smid=nytcore-iphone-share&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/upshot/one-third-dont-know-obamacare-and-affordable-care-act-are-the-same.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/world/middleeast/yemen-special-operations-missions.html?smid=tw-nytimes&smtyp=cur&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/us/politics/betsy-devos-education-secretary-confirmed.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url http://www.huffingtonpost.com/entry/republicans-are-about-to-erase-one-of-obamas-major-workplace-protections_us_5894caf8e4b09bd304bb359c?section=politics
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/05/health/with-fda-vacancy-trump-sees-chance-to-speed-drugs-to-the-market.html?smid=tw-nythealth&smtyp=cur
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/us/politics/melania-trump-libel-suit-daily-mail.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/interactive/2017/02/06/us/politics/why-trump-chose-the-seven-countries.html?_r=0
WARNING:__main__:unable to archive url http://assets.law360news.com/0473000/473998/carls.PDF
WARNING:__main__:unable to archive url http://www.washingtonexaminer.com/trump-tells-top-lawmakers-3-5-million-illegals-voted-in-election/article/2612762
WARNING:__main__:unable to archive url https://theshriverbrief.org/five-reasons-why-workers-deserve-a-labor-secretary-better-than-andrew-puzder-be1c903ff39f#.nthy3xcgs
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/05/us/politics/trump-white-house-aides-strategy.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://apnews.com/dff5863268a846bb9c8efea1523f249b/Trump's-nominee-for-Army-secretary-withdraws-his-name
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/03/us/visa-ban-legal-challenge.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.washingtonpost.com/news/business/wp/2017/02/03/trump-to-sign-executive-order-calling-for-rollback-of-wall-street-reform/?hpid=hp_hp-top-table-main_mm-doddfrank-435am%3Ahomepage%2Fstory&utm_term=.c1ca209729f4
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/02/world/europe/trump-european-union.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/02/us/politics/trump-johnson-amendment-political-activity-churches.html?ribbon-ad-idx=3&rref=homepage&module=Ribbon&version=origin&region=Header&action=click&contentCollection=Home%20Page&pgtype=article
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/01/us/politics/neil-gorsuch-supreme-court-trump.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/29/world/europe/trump-executive-order-europe-merkel.html?smid=tw-share&_r=0
WARNING:__main__:unable to archive url http://web.archive.org/web/20060514175300/http://www.computerworld.com/securitytopics/security/privacy/story/0,10801,110983,00.html
WARNING:__main__:unable to archive url http://www.enquirer.com/editions/2004/10/22/loc_blackwell22.html
WARNING:__main__:unable to archive url https://web.archive.org/web/20060821104145/http://www.wcpo.com/news/2006/local/03/29/blackwell.html
WARNING:__main__:unable to archive url https://web.archive.org/web/20070927192653/http://www.cantonrep.com/index.php?ID=285016&Category=13
WARNING:__main__:unable to archive url https://web.archive.org/web/20090326043320/http://auohio.org/assets/April%2017,%202006%20Evidence_FCC%20email.pdf
WARNING:__main__:unable to archive url http://web.archive.org/web/20150711234359/http://articles.philly.com/1996-03-08/news/25635573_1_shah-jahan-trump-palace-favorite-wife
WARNING:__main__:unable to archive url https://apnews.com/80497cfb5f054c9b8c9e0f8f5ca30a62?utm_campaign=SocialFlow&utm_source=Twitter&utm_medium=AP
WARNING:__main__:unable to archive url http://www.oregonlive.com/politics/index.ssf/2016/07/mike_pence_claims_donald_trump_will_overturn_roe_v_wade.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/29/world/middleeast/donald-trump-muslims-reaction.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url http://www.nytimes.com/aponline/2017/01/29/us/politics/ap-us-uber-trump-immigration.html?smid=fb-share
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/28/us/politics/annotating-trump-immigration-refugee-order.html?smid=fb-nytimes&smtyp=cur&_r=0
WARNING:__main__:unable to archive url https://www.washingtonpost.com/powerpost/paul-ryan-trumps-refugee-ban-does-not-target-muslims/2017/01/28/e0cf1fe4-e56e-11e6-a547-5fb9411d332c_story.html?utm_term=.87ccc04c88ac
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/29/world/europe/trump-executive-order-europe-merkel.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url http://www.nationallawjournal.com/home/id=1202777272340/12-Jones-Day-Lawyers-Take-Key-Posts-in-Trump-Administration?mcode=1202615432600&curindex=1&slreturn=20170028145244
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/28/us/refugees-detained-at-us-airports-prompting-legal-challenges-to-trumps-immigration-order.html?smprod=nytcore-iphone&smid=nytcore-iphone-share
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/26/us/politics/mexico-wall-tax-trump.html?action=Click&contentCollection=BreakingNews&contentID=64842749&pgtype=article
WARNING:__main__:unable to archive url https://www.washingtonpost.com/politics/whitehouse/several-senior-diplomats-resign-as-trump-admin-takes-shape/2017/01/25/8ac4ae28-e368-11e6-a419-eefe8eff0835_story.html?utm_term=.739243d28553
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/25/us/politics/trump-bernhard-langer-voting-fraud.html?_r=1&referer=https://t.co/MU5TAHryYL
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/09/16/us/politics/donald-trump-economy-speech.html?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/23/opinion/donald-trump-and-a-sea-of-empty-desks.html?_r=0
WARNING:__main__:unable to archive url http://www.vulture.com/2017/01/sean-spicer-inauguration-ratings-claims-fact-checked.html?mid=full-rss-vulture
WARNING:__main__:unable to archive url http://jezebel.com/republicans-introduce-bill-proposing-withdrawal-from-un-1791494159?utm_source=recirculation&utm_medium=recirculation&utm_campaign=mondayAM
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/19/us/politics/trump-russia-associates-investigation.html?action=click&contentCollection=Politics&module=RelatedCoverage&region=Marginalia&pgtype=article
WARNING:__main__:unable to archive url http://www.weeklystandard.com/trumpism-corrupts-spicer-edition/article/2006432
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/11/us/politics/trumps-press-conference-highlights-russia.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/20/us/politics/trump-executive-order-obamacare.html?action=Click&contentCollection=BreakingNews&contentID=64820933&pgtype=Multimedia
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/19/us/politics/trump-international-hotel-ethics.html?action=click&pgtype=Homepage&clickSource=story-heading&module=span-abc-region&region=span-abc-region&WT.nav=span-abc-region
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/20/us/politics/trump-white-house-website.html?action=click&pgtype=Homepage&clickSource=story-heading&module=span-abc-region&region=span-abc-region&WT.nav=span-abc-region&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/19/us/politics/trump-russia-associates-investigation.html?smid=tw-share&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/11/us/abortion-foes-donald-trump-restrictions-politics.html?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/06/us/politics/trump-wall-mexico.html?_r=0
WARNING:__main__:unable to archive url http://www.medialaw.org/index.php?option=com_k2&view=item&id=3470
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/17/us/politics/reince-priebus-chief-of-staff.html?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/17/us/politics/donald-trump-transition-tom-price.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=b-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/15/world/asia/trump-taiwan-china.html?_r=0
WARNING:__main__:unable to archive url http://www.thetimes.co.uk/article/full-transcript-of-interview-with-donald-trump-5d39sr09d
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/16/us/politics/donald-trump-russia-business.html?emc=edit_ta_20170116&nlid=43636183&ref=cta
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/11/28/us/politics/tom-price-secretary-health-and-human-services.html?_r=0t
WARNING:__main__:unable to archive url http://www.nytimes.com/aponline/2017/01/09/us/politics/ap-us-trump-epa-pruitt.html
WARNING:__main__:unable to archive url http://www.nytimes.com/reuters/2017/01/06/us/politics/06reuters-usa-trump-epa.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/07/us/politics/jared-kushner-trump-business.html?ref=todayspaper&_r=0
WARNING:__main__:unable to archive url http://www.huffingtonpost.com/entry/trump-advisor-potential-obamacare-conflict-interest_us_582efabde4b030997bbeda96?1s4p12jhdx8j2lnmi
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/09/us/jared-kushner-assets-conflict-of-interest.html?smid=tw-share&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/10/us/politics/trump-confirmation-hearings.html?emc=edit_na_20170110&nlid=29624742&ref=headline&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/02/us/illegal-immigrants-raids-deportation.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=second-column-region&region=top-news&WT.nav=top-news
WARNING:__main__:unable to archive url https://www.opensecrets.org/news/2017/01/fec-after-trump-and-his-jfcs-for-violations/
WARNING:__main__:unable to archive url https://thecaucus.blogs.nytimes.com/2011/04/28/rand-paul-questions-trumps-republican-credentials/?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/12/us/politics/mcconnell-supports-inquiry-of-russian-hacking-during-election.html?rref=collection%2Fnewseventcollection%2Frussian-election-hacking&action=click&contentCollection=politics&region=stream&module=stream_unit&version=latest&contentPlacement=10&pgtype=collection
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/06/us/politics/donald-trump-wall-hack-russia.html?smid=tw-nytimes&smtyp=cur
WARNING:__main__:unable to archive url http://www.nytimes.com/interactive/2016/07/27/us/politics/trail-of-dnc-emails-russia-hacking.html?rref=collection%2Fnewseventcollection%2Frussian-election-hacking&action=click&contentCollection=politics&region=rank&module=package&version=highlights&contentPlacement=3&pgtype=collection
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/10/27/us/politics/donald-trump-black-voters.html?_r=1
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/22/us/politics/state-department-gender-equality-trump-transition.html?_r=1
WARNING:__main__:unable to archive url http://www.inc.com/bartie-scott/silicon-valley-calls-for-thiels-dismisall-from-facebook.html
WARNING:__main__:unable to archive url https://webcache.googleusercontent.com/search?q=cache:ahgj-_Wg6TsJ:https://www.ft.com/content/2702da46-ae92-11e6-a37c-f4a01f1b0fa1+&cd=1&hl=en&ct=clnk&gl=us
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/11/us/politics/trumps-press-conference-highlights-russia.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions