---
title: 'How to get a list of website pages & metadata'
url: 'https://byintention.co/insights/how-to-get-list-of-website-pages-metadata'
markdown: 'https://byintention.co/insights/how-to-get-list-of-website-pages-metadata.md'
date: '2021-06-10'
description: 'Find out how to extract a list of website pages, the page addresses (URLs) and the meta titles and descriptions.'
taxonomy:
  category:
    - 'Search engine optimisation (SEO)'
---

[Blog](https://byintention.co/insights)

# How to get a list of website pages & metadata

10 June 2021

 Search engine optimisation (SEO) 

 ![How to get a list of website pages & metadata](https://byintention.co/user/media/extracting-urls-metadata-website.jpg) 

When building a new version of a website, we often need to extract the current pages, the page addresses (URLs) and the meta title and description. This can then be used to ‘310 redirect’ old pages to their new versions to help keep search engine rankings and avoid ‘page not found’ errors. This can be a time consuming task to do by hand!

Luckily there are two free tools that make this quick and easy.

## Getting a list of page URLs

![xml-sitemaps.com](https://byintention.co/wp-content/uploads/2021/06/xml-sitemaps.png)

Go to <https://www.xml-sitemaps.com/>, paste your website address into the bar and click start. Once it’s scanned all your pages, scroll down a bit and download the zip file containing all your sitemaps. Unzip these files to a folder and you’ll then see your sitemap in a variety of formats.

![list of downloaded sitemaps](https://byintention.co/wp-content/uploads/2021/06/list-of-downloaded-sitemaps-e1623322236683.png)

## Getting metadata

Open the urllist.txt file up (Should automatically open in Notepad on Windows and Textedit on Mac) and copy all the URLs. Go to <http://tools.buzzstream.com/meta-tag-extractor> and paste the list of URLs into the box on the left.

![extracting metadata from list of URLs](https://byintention.co/wp-content/uploads/2021/06/extracting-metadata-from-list-of-URLs.png)

Let that scan all your pages and click ‘download CSV’ under the list, and you now have a list of all the website’s pages, with their URLs, meta titles and meta descriptions. This can then be opened up in Numbers/Excel/Google Sheets so you can work out the redirects, and also copy the metadata out to paste into the SEO data plugin of the new site.

I love the [SEOPress](https://www.seopress.org/) plugin as its a lot less aggressive with adverts and upsells than the most common WordPress SEO plugin.

## Summary

By using these free tools and following these easy steps you’ve learned how extract a list of website pages, the page addresses (URLs) and the meta titles and descriptions.

---

## Navigation

- Parent: [Blog](https://byintention.co/insights.md)
- Previous: [What is your website purpose?](https://byintention.co/insights/what-is-your-website-purpose.md)
- Next: [Ecologi – helping a climate positive workforce](https://byintention.co/insights/ecologi-helping-a-climate-positive-workforce.md)

<!-- Added by Intention Header Footer Code plugin -->
<style>
@media only screen and (width < 48rem ) {
.home {
  #panel-6 {
    .container {
       text-align: center;
       .five {
         hyphens: none;
       }
    }
  }
}
  .page-contact .padded:first-child {
    padding: 0 0 2rem 0;
  }
}

.page-green-web-hosting {
  #panel-7 .bannerTint {
    background: none;
  }
  #panel-5 .text {
    width: 100%;
    flex: 0 0 100%;
  }
}

.page-sustainable-web-design {
    #panel-9 a:hover {
      color: var(--colour-text);
      text-decoration: underline;
    }
    #panel-9 .five {
       overflow: hidden;
    }
}
</style>

<!-- Added by Intention Header Footer Code plugin -->
<!-- Privacy-friendly analytics by Plausible -->
<script async src="https://plausible.io/js/pa-cDclpJQ-AUrkOCoNdz35l.js"></script>
<script>
  window.plausible=window.plausible||function(){(plausible.q=plausible.q||[]).push(arguments)},plausible.init=plausible.init||function(i){plausible.o=i||{}};
  plausible.init()
</script>