Toutiao Search's webmaster platform, under Toutiao, has officially launched. For us small webmasters, this is good news—at least there's some competition for Baidu. Below, we'll teach you how to submit your site's sitemap address to Toutiao Search to help get your website indexed.
Toutiao Search Webmaster Platform Address
Toutiao Search Webmaster Platform
If you don't have an account, register one first.
Submitting Sitemap URL to Toutiao Search
1. Log in to the Toutiao Search Webmaster Platform, go to Site Management, and add your website.
2. Enter your website URL. If your site has SSL enabled, select the https format.
3. Download the verification file, then use FTP software to upload it to the website root directory, click verify, and do not delete the file after verification passes.
4. Verification successful, submit the link.
5. Enter the sitemap address, fill it in, and then submit it.
Recommended Sitemap Plugins
If your website doesn't have a sitemap address yet, you can install a sitemap plugin yourself.
Search for sitemap in the WordPress backend; the first 4 results are all acceptable, among which.
Yoast SEO and All in One SEO Pack are SEO plugins, sitemap is their additional feature, which needs to be manually enabled. Yoast SEO only has sitemap available in the paid version.
Introduction to Toutiao Search Spider
Toutiao Search„s crawler UA is “Bytespider„ with the first letter capitalized.
For example:
例如：Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML,like Gecko)Chrome/41.0.6633.1032 Mobile Safari/537.36;Bytespider;bytespider@bytedance.com
Introduction to Toutiao Search IP Fields
The ip fields for Toutiao Search involve a total of 6, with specific fields as follows:
110.249.201.0/24 110.249.202.0/24 111.225.148.0/24 111.225.149.0/24 220.243.135.0/24 220.243.136.0/24
Basic Process
1. Crawling web pages. Each independent search engine has its own web crawler program (Spider). The crawler follows hyperlinks on web pages, moving from one website to another, continuously accessing and crawling more pages through hyperlink analysis. The crawled pages are called web snapshots. Due to the widespread use of hyperlinks on the internet, theoretically, starting from a certain range of web pages can collect the vast majority of web pages.
2. Processing web pages. After the search engine crawls web pages, it still needs to perform a lot of preprocessing work to provide retrieval services. Among them, the most important is extracting keywords and building an index library and indexes. Others include removing duplicate pages, word segmentation (for Chinese), determining page types, analyzing hyperlinks, calculating page importance/richness, etc.
3. Providing retrieval services. Users input keywords for retrieval, and the search engine finds web pages matching those keywords from the index database; to help users judge, in addition to the page title and URL, it also provides a summary from the webpage and other information.
Issue Feedback
1. If you find that your website has a large amount of crawling by Toutiao spider„s UA “Bytespider„, causing your website to slow down or crash, you can use the “Crawl Frequency„ feature to set crawl requirements for your website, and it will take effect within 1 day.
2. For other spider-related issues, you can submit feedback to zhanzhang@bytedance.com, and we will handle it promptly.
Related articles:
How to Get a Website Indexed by Baidu_About Website Indexing and Ranking Matters