{"id":3253,"date":"2021-05-31T07:39:20","date_gmt":"2021-05-30T22:39:20","guid":{"rendered":"http:\/\/matoken.org\/blog\/?p=3253"},"modified":"2021-05-31T07:26:42","modified_gmt":"2021-05-30T22:26:42","slug":"set-robots-txt-in-nitter-alias-setting-in-reverse-proxy-environment-of-apache-httpd","status":"publish","type":"post","link":"https:\/\/matoken.org\/blog\/2021\/05\/31\/set-robots-txt-in-nitter-alias-setting-in-reverse-proxy-environment-of-apache-httpd\/","title":{"rendered":"Nitter\u306brobots.txt\u3092\u8a2d\u5b9a(Apache httpd\u306ereverse proxy\u74b0\u5883\u3067Alias\u8a2d\u5b9a)"},"content":{"rendered":"<div class=\"paragraph\">\n<p>\u4ee5\u524d\u8efd\u91cfTwitter\u30d5\u30ed\u30f3\u30c8\u30a8\u30f3\u30c9\u306eNitter \u3092\u30bb\u30eb\u30d5\u30db\u30b9\u30c8\u3057\u307e\u3057\u305f\uff0e<\/p>\n<\/div>\n<div class=\"ulist\">\n<ul>\n<li><a href=\"https:\/\/matoken.org\/blog\/2021\/02\/17\/self-hosting-the-lightweight-twitter-front-end-nitter\/\">\u8efd\u91cfTwitter\u30d5\u30ed\u30f3\u30c8\u30a8\u30f3\u30c9\u306eNitter\u3092\u30bb\u30eb\u30d5\u30db\u30b9\u30c8 \u2013 matoken\u2019s meme<\/a><\/li>\n<\/ul>\n<\/div>\n<div class=\"paragraph\">\n<p>\u6700\u8fd1\u30a2\u30af\u30bb\u30b9\u304c\u5897\u3048\u3066\u3044\u3066\u5c11\u3057\u30b5\u30fc\u30d0\u304c\u91cd\u304f\u306a\u3063\u305f\u308a\u81ea\u5206\u304c\u4f7f\u3046\u3068\u304d\u306b\u8abf\u5b50\u304c\u60aa\u304b\u3063\u305f\u308a\u3057\u3066\u3044\u307e\u3059\uff0e\u30af\u30ed\u30fc\u30e9\u306a\u3093\u304b\u304c\u591a\u3044\u3088\u3046\u306a\u306e\u3067\u3053\u308c\u3092 <code>robots.txt<\/code> \u3067\u62d2\u5426\u3059\u308b\u3068\u5927\u5206\u30a2\u30af\u30bb\u30b9\u304c\u6e1b\u308b\u306e\u3067\u306f\u3068\u601d\u3044\u8a2d\u5b9a\u3057\u3066\u307f\u307e\u3057\u305f\uff0e<\/p>\n<\/div>\n<p><!--more--><\/p>\n<div class=\"paragraph\">\n<p>\u307e\u305a\u306f<a href=\"https:\/\/github.com\/zedeus\/nitter\/issues\/305#issuecomment-841933813\">\u9069\u5f53\u306a <code>robots.txt<\/code><\/a> \u3092 <code>Nitter<\/code> \u306e Root \u306b\u7f6e\u3044\u3066\u307f\u307e\u3057\u305f\u304c\uff0c\u5bfe\u5fdc\u3057\u3066\u3044\u306a\u3044\u3088\u3046\u3067\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u305b\u3093\uff0e<br \/>\nNitter \u306e\u524d\u6bb5\u306b\u7f6e\u3044\u3066\u3042\u308b Apache2 httpd \u3067Alias \u3092\u8a2d\u5b9a\u3059\u308c\u3070\u3068\u601d\u3063\u3066Apache httpd \u306eNitter \u306e\u8a2d\u5b9a\u306e <code>VirtualHost<\/code> \u306e\u4e2d\u306b\u4ee5\u4e0b\u306e\u8a2d\u5b9a\u3092\u8ffd\u52a0\u3057\u3066\u307f\u307e\u3057\u305f\uff0e<\/p>\n<\/div>\n<div class=\"listingblock\">\n<div class=\"title\">\/etc\/apache2\/sites-available\/nitter.matoken.org.conf<\/div>\n<div class=\"content\">\n<pre class=\"highlight\"><code class=\"language-apache\" data-lang=\"apache\">        Alias \/robots.txt \/home\/nitter\/robots.txt\n        &lt;Location \"\/robots.txt\"&gt;\n                Require all granted\n        &lt;\/Location&gt;<\/code><\/pre>\n<\/div>\n<\/div>\n<div class=\"ulist\">\n<ul>\n<li><a href=\"https:\/\/httpd.apache.org\/docs\/2.4\/mod\/mod_alias.html\">mod_alias &#8211; Apache HTTP \u30b5\u30fc\u30d0 \u30d0\u30fc\u30b8\u30e7\u30f3 2.4<\/a><\/li>\n<\/ul>\n<\/div>\n<div class=\"paragraph\">\n<p>\u8ffd\u52a0\u3057\u305f\u3042\u3068\u8a2d\u5b9a\u3092\u78ba\u8a8d\u3057\u3066\u8a2d\u5b9a\u3092\u518d\u8aad\u8fbc\u3057\u307e\u3059\uff0e<\/p>\n<\/div>\n<div class=\"listingblock\">\n<div class=\"content\">\n<pre class=\"highlight\"><code class=\"language-shell\" data-lang=\"shell\">$ sudo a2ensite nitter.matoken.org.conf\n$ sudo apache2ctl configtest\n$ sudo systemctl reload apache2<\/code><\/pre>\n<\/div>\n<\/div>\n<div class=\"paragraph\">\n<p>\u3057\u304b\u3057\u3053\u306e\u72b6\u614b\u3067 <code>\/robots.txt<\/code> \u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u3068http \u30b9\u30c6\u30fc\u30bf\u30b9\u30b3\u30fc\u30c9 <code>404<\/code> \u304c\u5e30\u3063\u3066\u304d\u3066\u30a2\u30af\u30bb\u30b9\u3067\u304d\u307e\u305b\u3093\uff0eProxy \u306e\u65b9\u304c\u512a\u5148\u306e\u3088\u3046\u3067\u3059\uff0e<\/p>\n<\/div>\n<div class=\"paragraph\">\n<p>\u691c\u7d22\u3057\u3066\u307f\u308b\u3068\u4ee5\u4e0b\u306epage\u3092\u898b\u3064\u3051\u307e\u3057\u305f\uff0e <code>ProxyPass<\/code> \u3067 <code>!<\/code> \u3092\u6307\u5b9a\u3057\u3066\u6307\u5b9a\u3057\u305fURL\u3092Proxy \u3067\u7121\u8996\u3059\u308b\u3088\u3046\u306b\u3067\u304d\u308b\u3088\u3046\u3067\u3059\uff0e<\/p>\n<\/div>\n<div class=\"ulist\">\n<ul>\n<li><a href=\"https:\/\/confluence.jaytaala.com\/display\/TKB\/Global+robots.txt+on+Apache+reverse+proxy\">Global robots.txt on Apache reverse proxy &#8211; Tech Knowledge Base &#8211; jaytaala.com Confluence<\/a><\/li>\n<li><a href=\"https:\/\/httpd.apache.org\/docs\/2.4\/mod\/mod_proxy.html#proxypass\">mod_proxy &#8211; Apache HTTP \u30b5\u30fc\u30d0 \u30d0\u30fc\u30b8\u30e7\u30f3 2.4<\/a><\/li>\n<\/ul>\n<\/div>\n<div class=\"paragraph\">\n<p>\u3068\u3044\u3046\u3053\u3068\u3067\u3053\u306e\u3088\u3046\u306b\u8a2d\u5b9a\u3057\u3066\u307f\u307e\u3057\u305f\uff0e<\/p>\n<\/div>\n<div class=\"listingblock\">\n<div class=\"content\">\n<pre class=\"highlight\"><code class=\"language-apache\" data-lang=\"apache\">        Alias \/robots.txt \/home\/nitter\/robots.txt\n        &lt;Location \"\/robots.txt\"&gt;\n                ProxyPass !\n                Require all granted\n        &lt;\/Location&gt;<\/code><\/pre>\n<\/div>\n<\/div>\n<div class=\"paragraph\">\n<p>\u518d\u5ea6\u8a2d\u5b9a\u30c1\u30a7\u30c3\u30af\u3057\u3066\u518d\u8aad\u8fbc\u3059\u308b\u3068\u52d5\u4f5c\u3057\u307e\u3057\u305f :)<\/p>\n<\/div>\n<div class=\"listingblock\">\n<div class=\"content\">\n<pre class=\"highlight\"><code class=\"language-shell\" data-lang=\"shell\">$ w3m -dump_head https:\/\/nitter.matoken.org\/robots.txt\nHTTP\/1.1 200 OK\nDate: Sun, 30 May 2021 15:26:17 GMT\nServer: Apache\/2.4.38 (Debian) OpenSSL\/1.1.1d\nLast-Modified: Mon, 12 Apr 2021 23:19:53 GMT\nETag: \"32c8-5bfcec03dd840-gzip\"\nAccept-Ranges: bytes\nVary: Accept-Encoding\nContent-Encoding: gzip\nContent-Length: 2938\nConnection: close\nContent-Type: text\/plain<\/code><\/pre>\n<\/div>\n<\/div>\n<div class=\"paragraph\">\n<p>1\u65e5\u307b\u3069\u5f85\u3063\u3066\u304b\u3089\u30a2\u30af\u30bb\u30b9\u306e\u5909\u5316\u3092\u898b\u3066\u307f\u3088\u3046\u3068\u601d\u3044\u307e\u3059\uff0e<\/p>\n<\/div>\n<div class=\"listingblock\">\n<div class=\"title\">\u74b0\u5883<\/div>\n<div class=\"content\">\n<pre>$ dpkg-query -W apache2\napache2 2.4.38-3+deb10u4\n$ lsb_release -dr\nDescription:    Debian GNU\/Linux 10 (buster)\nRelease:        10\n$ arch\nx86_64<\/pre>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>\u4ee5\u524d\u8efd\u91cfTwitter\u30d5\u30ed\u30f3\u30c8\u30a8\u30f3\u30c9\u306eNitter \u3092\u30bb\u30eb\u30d5\u30db\u30b9\u30c8\u3057\u307e\u3057\u305f\uff0e \u8efd\u91cfTwitter\u30d5\u30ed\u30f3\u30c8\u30a8\u30f3\u30c9\u306eNitter\u3092\u30bb\u30eb\u30d5\u30db\u30b9\u30c8 \u2013 matoken\u2019s meme \u6700\u8fd1\u30a2\u30af\u30bb\u30b9\u304c\u5897\u3048\u3066\u3044\u3066\u5c11\u3057\u30b5\u30fc\u30d0\u304c\u91cd\u304f\u306a\u3063\u305f [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"webmentions_disabled_pings":false,"webmentions_disabled":false,"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":4,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[428,7,6],"tags":[77,593],"class_list":["post-3253","post","type-post","status-publish","format-standard","hentry","category-buster","category-debian-linux","category-linux","tag-apahce-httpd","tag-nitter"],"_links":{"self":[{"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/posts\/3253","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/comments?post=3253"}],"version-history":[{"count":0,"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/posts\/3253\/revisions"}],"wp:attachment":[{"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/media?parent=3253"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/categories?post=3253"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/matoken.org\/blog\/wp-json\/wp\/v2\/tags?post=3253"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}