Two small text files decide how smoothly Google understands your site. Here is what goes in each.
robots.txt: the bouncer Lives at yoursite.com/robots.txt. Tells crawlers what NOT to fetch: admin areas, search results, form endpoints. A sensible business-site version allows everything except the private parts — and unlike a mysterious meta tag, everyone can read it (including competitors, so do not list secret URLs there).
Kairalmas serves one automatically: content pages allowed, action endpoints and search scripts excluded.
sitemap.xml: the table of contents A machine-readable list of your pages with last-modified dates. It does not make Google rank you — it makes sure Google FINDS everything, especially new blog posts.
The Kairalmas sitemap regenerates automatically: main pages, SEO landing pages and every published blog article with its update date. When you publish a post, the sitemap updates within the minute.