Public SEO Roast

Nomad List SEO Audit

Nomads List's traffic plummeted after migrating to nomads.com. Key issues: firewall blocking Googlebot, faulty redirects (missing domains, infinite loops), title tag inconsistencies, and "nofollow" misuse on backlinks. Fixing these, especially the firewall, is crucial for recovery.

nomads.com181 transcript segments
Roast my site next
0:00 / 0:00

Full Video Transcript

hey everyone today i'll be taking a look at nomads list and they lost a huge amount of traffic so they had about 3540 pages with 14k traffic back in august of last year and he moved his site from nomadlist.com to nomads.com the traffic did recover a little bit but not enough as you'll see here now he has 262 pages indexed with about 5k traffic which is a good recovery but you lost like a huge amount of your traffic so that's pretty bad before i check i wanted to maybe share a quick update and that's that the programmatic co course that i've been working on it's going quite well let me check my examples one of the first one that i'm shipping as a as part of the template will be a simple example right here it's going to be like a recipe generator like a simple website so just to show that how you can generate like a bunch of pages one of the first examples that you have for example is the home page you'll get the entire template the entire page everything works all this co is set up correctly and perfectly it has all the h1 h2 tags it has a conanacorea with a robust meta tag and everything is set up perfectly so it has all my templates that i use for every site which includes like the next.js code and everything and i'll include as part of this a bunch of ai scripts as well for example if you're cooking something like chicken you can generate a recipe based on this and it's gonna give you all the ingredients it's streaming also like the actual contents so you can have not just a text stream that you need to parse but it's generating objects using virtual sdk and then i'll have it and generate some images as well and then these items will be saved in the database and then when you click on them you can see also the pages and the page also has a recipe slash something so it's the entire template i'll make a bunch of these and each of these is going to be a separate next.js mini app that has all the things that i use including like the layout the page the error even like og image generation that becomes part of it the database stuff so it's going to be awesome as part of the course we are still working on it here's some pages you'll be able to like navigate this is a quick example but i'm definitely starting on the course it's like explaining the concept and everything and we are also working on a bunch of case studies the idea is that we'll review a lot of websites tell you like what type of programmatic SEO strategies that they use how many indexed pages they have and a bunch of screenshots as well we were working on looking at nomads list to add it to the site examples but i saw like actually something went wrong because i couldn't find really good examples and let's try to find out why so let me first log out of my account to see exactly what the hell it looks like if you are just navigating it and dive into the site migration that went on so we see here that we are looking at the website so the amount of traffic that we get to the home page it's almost only like nomads list as a keyword so that means that all the other pages are not really reflected because they have like about 300 real traffic and they have some pages but it's not that much it's like best places to live okay best place in the world they lost a lot of the traffic at nomads.com when they migrated they some of the pages have been migrated correctly but not everything and the way that i would try to figure this out is look at both of the websites and see how they moved from one to the other for example let's see we have a backlinks from hbr.org that's going from here to nomads list and then to nomads.com so this migration should be good like it's redirecting correctly photo.ai.com it said there was an error on this page nomads let's see back by nomads no we can check the outgoing links in the and here so we still have the old domains but for some reason photo.ai.com has a no follow to nomads list so he's not like getting all the seo traffic that's super weird actually so that should be ideally a do follow because it's the same domain unless he sold nomads list but i doubt it so it had a lot of like content from before because for example this one was i guess the domain before he bought this one that might be impacting the seo but i don't think it's going to be that bad because it's still like a decent backlink just the thing here that i see here it's like redirecting to stuff but it's redirecting in the wrong way so i think there's an issue with the redirect so one app that i use is like redirect checker which is pretty simple to use and then if we ram it in here we see the 301 that we get so the location that it's forwarding to as a 301 is places with no natural disasters and no earthquake risk and low error threat and no armed conflict so he's redirecting to this place for some reason uh yeah it's wrong it should be yeah he has like a bunch of issues on the website i guess haha php but um let's see okay so this page is redirecting without the 4EL so if you make a 301 redirect in your http headers you need to include the full domain name so that's missing that's 100% wrong this should be not this location but if you make correctly it should be slash snomad.com slash this and i'm guessing this page might exist but if you make a 301 redirect without the 4EL it's gonna especially without the slash it's gonna be wrong and even this page is somehow redirecting infinite amount of times so it's looping so if we check the redirects for this it tells us there's too many requests i don't know why so he has like a bug or issue on the website okay there's probably one thing let's check chiang mai this looks correct this is a bit of a long description probably something that can be improved but it's not gonna be the cause of the issue except yeah like nomads list is correctly redirecting to this one so this is all this all seems good okay one thing that we can do on the other side is look at his older website which is nomadlist.com and then we will see the traffic charts over here this doesn't help us specifically because it's like of course like everything is lost right but what you can do in Ahrefs is you click like on historical data to go back and then we can see that he has like a bunch of pages over here that are that had a lot of traffic so 14k and i think the ideal way to figure this out is like click on all of these and see what they're going through so this nomadlist countries was ranking really well for best countries to live in and if we google this now we don't really see the website so it's 100 gone for him so yeah this is the issue it's best countries to live in this seems okay the SERP data in the past was best countries to live in and one thing you can do in here is you can inspect as well on the an Ahrefs to see how that page looks like in the past yeah so now we can load the full html of a previous position and also look at everything that happened at that time so that will help us figure out like to do like a comparison view between the two so if we open up Ahrefs here paste this in paste this in we can look at the current position of this page so it's not ranking at all nomadic countries okay let me check first the backlinks here so this seems correct and it's correcting correctly redirecting nomadlist countries i think maybe the only thing that is wrong is like the html that is being rendered is okay but the full list that is being rendered is just countries so maybe that could be one issue for example if you open like this inspect element i believe he has two title tags one title tag here yeah it's hand coded by him alone so title tag here is countries without anything else but i think there's a second title tag or no i think it just means that if you open like page source it's the correct title tag but then it becomes then it's replaced somehow in javascript later for the wrong title tag so it should be this one ideally without spaces that would probably be better but it doesn't seem like this should impact it as much however yeah you never know and maybe it doesn't really like the issue but what i see here like it's returning a 429 too many requests issue so that's not good let me check if i log out of my account which i thought i did what happens so it's logging in again so logout isn't really working if i open it yeah so if i open it on incognito it's a little bit different than my actual page so this looks different so this also gives us countries as a result i don't have hrefs here but maybe it looks yeah maybe it looks a little bit different than the other one but yeah it's weird that it doesn't um do with my cookies so i'm gonna clear it like all storage and then refresh yeah and this gives us the right domain okay it's still doing the rendering thing but it's an issue and then we do a page inspect to see how both of these websites look like in the past we can do a full comparison of both and see what like change on the website maybe we open up this wait let me open the programatica co course to make it easier all right so this is a very simple comparison thing nomads.html paste in the old version we save it yeah save it we add it to our changes then we paste in the new version and then we can see the comparison if there is any oh i didn't save it last time okay so now we have this version let's put in this old version and add this to our change log and then save it again it's just because of course it's being a bit slow all right and let's see the differences in html it's just because normally you can do a side-by-side comparison for the newest version but if it's like across a different site it doesn't work so we cannot really do like a full comparison view like here your static cache buster he added like this to the new site so no one's list this seems correct or jury else seems correct we went from site name nomads.com from nomad list to nomads.com so maybe that could be an issue that google sees it as a different type of site maybe you could try changing that back instead of nomads.com like nomad list had like good brand recognizability so if you would look for something like nomad list that would be like a decent keyword for a lot of content but now it sees it as like best places to live for digital nomads here on top and this is like your site name and the site name that it's actually using is not best places to live for nomads it's using this part so for some reason uh maybe because you have it like often mentioned in your content but your application name should be a reflection of that so maybe yeah that's just google being weird but yeah yeah it's definitely using like nomads.com everywhere maybe that could be an issue maybe not it's hard to tell let's see let's scroll through everything else so yeah it's like structured data changed a bit a little bit you have more content i think maybe it's like the 429 issues as well because otherwise there's not that much changes don't have many changes except like the title that's been changing but i guess that was also like in the older version where it would redirect to the different type but all right let's see what else do we have nomadlist.com best countries to live in fire calculator let's see if this exists so this is now part of a this should still be getting traffic but it doesn't wait okay it's rendered it's not in the head so the title should be in the head probably yeah so it's oh you should move it to the head now it's like in the body somewhere you don't put your title in the body um fire calculator it's probably valid-ish but i mean it shouldn't be there it should definitely be in the head but i guess google still recognize it in some way but that's definitely an issue final independence calculator is that what it's what people are looking for it's like fire calculator maybe you could call it like fire calculator in the top instead of this one but that's beside the point let's see how it ranks right now and yeah basically lost all traffic as well oh it's crazy so it's about 30 and in the past it was 11 as well yeah so it went from position 11 to position 30 just for this keyword and it had a lot of volume for 5600 volume this one has 20 volume so maybe it's at the time there was more popular let's check now it should still have the same amount of volume one thing that we can check here is how it was changed so this was august 2024 and we can compare it to that time so let's see august or last year and compare yeah was it 15 august yeah it should have been still high no mats yeah so it was here and then it was completely gone so it was in position nine uh now if we check it's just completely gone but a lot of stuff has moved around like walletburst has moved higher this one from networth defy has also moved higher in this one as well some others have lost the position but it's bad that it's also like completely gone and it was like for the right title fire calculator but it should still not have that such a huge impact unless it's like some other issues like robots.txt which don't have you should have robots.txt ideally so yeah maybe add the robots.txt and if we what we can do also in hs i did this in the past in the search console is you can do an user agent switcher to use like a googlebot and see a refresh what happens all right so if you load this with googlebot the website is completely gone yeah this seems like an issue yeah and then it's errors with like too many requests is this because it's checking my user agent i'm guessing so and then let's change it to mobile and it instantly works and if i change it back to googlebot it dies okay i'm guessing yes you have a fireball like on flatflare and it's literally like tanking the entire website on google if we check countries change our user agent again here and then do like a refresh it's still okay but on the other pages yeah it's getting too many requests okay you have some fireball that's causing the entire site to crash just on google so one thing that i would recommend is if you open your search console and you type in your website let me check which website i'm on coros.com that's good enough to show we can have we can get the index and then we can also show just any crawler issues so one thing that you can check is like your patient indexing time like the last crawl how it was crawled as like google smartphone if it was allowed if the page was fetched successfully if indexing was allowed and then you can also check the actual page how it was shown one thing that is super important to check as well is do a test live screenshot so this will actually show you how the page looks like the google once i had an issue where everything worked fine but googlebot has maybe like a different rendering engine just a little bit older and it's going to look different than just you know like firefox or chrome so it's going to look different so make sure that it looks good on the screenshot that because that's how google looks at your page and it's also like very important to do so make sure that you don't miss that but yeah actually probably we can finish this off quickly and then open some of these pages and see how they look like because the seo strategy in the past was good right it's like cost of living in medellín bonas aires and you have all these awesome pages that show like a lot of content all of them have like high quality of information you can create like a lot of content for nomad guide pros and cons chat people photos of bonas aires weather and bonas aires trends and bonas aires demographics and bonas aires so you have a lot of possibility of different content which was really good and it all seems to be redirecting quite well but i guess it's just you're getting like too many requests and then it crashes for some reason so that's not good and this one best places for workers to live it's redirecting too many times so i'm guessing you made a redirect mistake here as well if we check it for this tool it's redirecting us to the same page so it's going from nomads.com to well basically itself and it's looping or something and then it gets too many requests and it just dies so this page is gone for google right so like you're using that traffic losing that traffic as well here's a screenshot it looks pretty good and everything looks good then you're fine so do that test it's super important yeah make sure that you do this well that's about it i guess that's a good roast and probably helpful it's a lot of site issues mostly so i think if you just fix those things you have all your backlinks should be moved to the new site and you'll be 100% fine but otherwise like you went from 14k traffic to almost like nothing so it's very bad make sure you fix it good luck
Nomad List

Audit Breakdown

nomads.com
levelsio
levelsio

Best places to live for digital nomads

Actual roast notes

The teardown

No template scorecard here. The details below come from this specific audit.

Case Study: Nomads List's Traffic Nosedive - A Deep Dive into a Troubled Site Migration


Hey everyone, today we're doing a deep dive into a fascinating (and cautionary) SEO case study: the significant traffic drop experienced by Nomads List after their recent domain migration.

We'll analyze what went wrong and extract valuable lessons for anyone considering a similar move.

The Problem: From 14k to 5k Organic Traffic

embed

Nomads List, a popular resource for digital nomads, recently migrated from nomadlist.com to nomads.com. While seemingly a straightforward domain upgrade, the results were far from ideal.

  • Before Migration (August): ~3,540 pages indexed, ~14,000 organic traffic.
  • After Migration: ~262 pages indexed, ~5,000 organic traffic.

That's a staggering loss of nearly two-thirds of their organic traffic! While some recovery is evident, it's clear that significant issues plagued the migration process.

1. Backlink Issues and "No Follow" Misuse

image.png

Examining Nomads List's backlink profile revealed some troubling inconsistencies:

  • HBR.org Backlink: A valuable backlink from hbr.org correctly redirects from the old domain to the new one, indicating a proper 301 redirect implementation in this instance.
  • PhotoAI Backlink: However, a backlink from ai.com to the old domain was tagged as "nofollow." This is a significant error, as "nofollow" attributes prevent the transfer of link equity (SEO value) to the new domain. This likely hindered the new domain's ability to inherit the authority of the old one.

It is speculated that the previous domain that was redirecting to nomadlist.com might be impacting the SEO negatively. However, there is an issue with the redirects, as they seem to be set up incorrectly.

2. Redirect Errors and Infinite Loops

image.png

The audit uncovered several critical redirect issues:

  • Missing Full Domain in 301 Redirects: Many 301 redirects were implemented without the full domain name (e.g., redirecting to "/page" instead of "https://nomads.com/page"). This is a fundamental error that can confuse search engines and lead to indexing problems.

    image.png

  • Infinite Redirect Loops: Some pages were caught in infinite redirect loops, causing "Too Many Redirects" errors. This effectively makes these pages inaccessible to both users and search engines. One example is the "best places for workers to live" page, which redirects to itself.

  • Incorrect HTTP Headers: Redirects were often implemented without the trailing slash, further contributing to the redirect errors.

These redirect problems likely resulted in significant loss of link equity and user experience issues.

3. Title Tag Inconsistencies and Rendering Problems

image.png

  • JavaScript-Based Title Tag Changes: The audit found that the initial title tag in the HTML source code was often replaced by a different title tag via JavaScript. While Google can generally render JavaScript, this practice can introduce inconsistencies and potentially confuse search engines. Specifically, the /countries page has the correct title in the source code but is replaced with just "Countries" by JavaScript, which is not ideal.
  • Multiple Title Tags: Some pages had multiple title tags, which is an SEO best practice violation.
  • Title Tag in Body: The /fire-calculator page has its title tag in the <body> section instead of the <head>. While Google might still pick it up, it's not valid HTML and should be corrected.

4. Firewall Blocking Googlebot

image.png

Perhaps the most critical finding was that Nomads List's firewall was blocking Googlebot, resulting in "Too Many Requests" errors for many pages. This effectively prevented Google from crawling and indexing a significant portion of the site.

  • User-Agent Switching Test: Using a user-agent switcher to mimic Googlebot revealed that many pages were inaccessible, while switching to a mobile user-agent allowed access.
  • Google Search Console: Checking Google Search Console for crawl errors would have immediately highlighted this issue.

This finding is almost certainly the main reason the number of pages indexed dropped from over 3,000 to just over 200. The firewall is blocking Google from accessing the content.

5. Potential Issues with Site Name Change

image.png

The migration also involved a change in the site name from "Nomad List" to "Nomads.com." While not definitively proven, this change might have impacted Google's perception of the site's brand and topical relevance. The site name that Google uses in the SERPs is "Best places to live for digital nomads," which is pulled from the H1 on the home page. It does not seem to be using the application name set in the structured data.

6. Other Minor Issues

image.png

  • Missing Robots.txt: The site lacks a robots.txt file, which is recommended for providing instructions to search engine crawlers.
  • 429 Errors: Some pages returned 429 "Too Many Requests" errors, even for regular users, indicating potential server-side issues.

Recommendations for Recovery

embed

Based on the audit findings, here are the key recommendations for Nomads List to recover their lost traffic:

  1. Fix the Firewall: Immediately address the firewall issue blocking Googlebot. This is the highest priority and likely the biggest contributor to the traffic drop.
  2. Correct Redirects: Implement all 301 redirects correctly, including the full domain name and trailing slash. Ensure no redirect loops are present.
  3. Review and Correct Title Tags: Ensure each page has a single, relevant title tag placed within the <head> section. Avoid JavaScript-based title tag manipulation.
  4. Fix "Nofollow" Backlinks: Reach out to sites with "nofollow" backlinks pointing to the old domain and request they be changed to "dofollow" or removed. It should ideally be a do-follow because it is for the same brand.
  5. Add a Robots.txt File: Create and implement a robots.txt file to guide search engine crawlers.
  6. Investigate 429 Errors: Address the root cause of the 429 errors to improve site performance and user experience.
  7. Monitor Google Search Console: Regularly check Google Search Console for crawl errors, indexing status, and other performance issues. Use the "URL Inspection" tool and "Live Test" to see how Google is rendering the pages.
  8. Consider Reverting Site Name: If feasible, consider reverting the site name in structured data and throughout the site to "Nomad List" to potentially regain brand recognition.

Conclusion

The Nomads List case study serves as a stark reminder of the complexities involved in site migrations. Seemingly minor errors can have devastating consequences for organic traffic. By addressing the identified issues, particularly the firewall blocking Googlebot and the numerous redirect errors, Nomads List has a good chance of recovering their lost traffic and regaining their position as a leading resource for digital nomads.

This audit highlights the importance of meticulous planning, thorough testing, and ongoing monitoring during any site migration or major SEO changes. Remember to always prioritize user experience and ensure your site is easily accessible to both users and search engines. Good luck!