Facebook file doesn't exist showing up continuously in apache log - facebook

I am seeing these error entries in our apache logs all the time.
We have the FB like button on our website
Any suggestions on what's causing it, or how to rectify?
[Fri Oct 18 07:50:22 2013] [error] [client 108.168.210.164] File does not exist: /var/www/www.facebook.com
[Fri Oct 18 07:50:49 2013] [error] [client 108.168.210.164] File does not exist: /var/www/www.facebook.com
[Fri Oct 18 07:50:54 2013] [error] [client 5.10.84.4] File does not exist: /var/www/www.facebook.com

More often than not, Apache errors of the form
[Fri Oct 18 07:50:22 2013] [error] [client 108.168.210.164] File does not exist: /var/www/www.hostname.com
indicate that the client has received a relative URL, ie one without "http://".

Related

Thinking-sphinx FATAL: failed to create binlog.001, error=Too many open files

I am using Sphinx 2.2.11-id64-release and gem 'thinking-sphinx', '3.3.0'.
rake ts:configureworks fine and generated development development.sphinx.conf
But when running sphinx rake ts:index ts:start it fails and shows these errors in logs:
[Fri Dec 21 18:00:19.858 2018] [31823] WARNING: index 'section_not_today_1_with_text_89_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/89/section_not_today_1_with_text_89_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.858 2018] [31823] WARNING: index 'section_today_0_with_text_address_89_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/89/section_today_0_with_text_address_89_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.858 2018] [31823] WARNING: index 'section_not_today_0_with_text_address_89_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/89/section_not_today_0_with_text_address_89_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.859 2018] [31823] WARNING: index 'section_today_1_with_text_address_89_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/89/section_today_1_with_text_address_89_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.859 2018] [31823] WARNING: index 'section_not_today_1_with_text_address_89_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/89/section_not_today_1_with_text_address_89_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.860 2018] [31823] WARNING: index 'section_today_0_with_text_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/90/section_today_0_with_text_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.860 2018] [31823] WARNING: index 'section_not_today_0_with_text_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/90/section_not_today_0_with_text_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.860 2018] [31823] WARNING: index 'section_today_1_with_text_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/90/section_today_1_with_text_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.861 2018] [31823] WARNING: index 'section_not_today_1_with_text_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/90/section_not_today_1_with_text_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.861 2018] [31823] WARNING: index 'section_today_0_with_text_address_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/90/section_today_0_with_text_address_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.862 2018] [31823] WARNING: index 'section_not_today_0_with_text_address_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/90/section_not_today_0_with_text_address_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.862 2018] [31823] WARNING: index 'section_today_1_with_text_address_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/90/section_today_1_with_text_address_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.863 2018] [31823] WARNING: index 'section_not_today_1_with_text_address_90_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/90/section_not_today_1_with_text_address_90_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.863 2018] [31823] WARNING: index 'section_today_0_with_text_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/91/section_today_0_with_text_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.864 2018] [31823] WARNING: index 'section_not_today_0_with_text_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/91/section_not_today_0_with_text_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.864 2018] [31823] WARNING: index 'section_today_1_with_text_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/91/section_today_1_with_text_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.864 2018] [31823] WARNING: index 'section_not_today_1_with_text_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/91/section_not_today_1_with_text_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.865 2018] [31823] WARNING: index 'section_today_0_with_text_address_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/91/section_today_0_with_text_address_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.865 2018] [31823] WARNING: index 'section_not_today_0_with_text_address_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development0/91/section_not_today_0_with_text_address_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.865 2018] [31823] WARNING: index 'section_today_1_with_text_address_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/91/section_today_1_with_text_address_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.866 2018] [31823] WARNING: index 'section_not_today_1_with_text_address_91_idx_core': preload: failed to open /home/tyler/nmir/db/sphinx/development1/91/section_not_today_1_with_text_address_91_idx_core.spa: Too many open files; NOT SERVING
[Fri Dec 21 18:00:19.868 2018] [31823] FATAL: failed to create /home/tyler/nmir/tmp/binlog/development/binlog.001: errno=24, error=Too many open files
[Fri Dec 21 18:00:19.915 2018] [31822] watchdog: main process 31823 exited cleanly (exit code 1), shutting down
As #barryhunter has noted, the issue here is the number of files that you're allowed to open at an operating system level. You're hitting this because of the large number of Sphinx indices you've got defined - but there should be ways around it - perhaps by using ulimit, as Barry's linked to in the comment.
Solved this issue by adding the following line to both /etc/systemd/system.conf and /etc/systemd/user.conf
DefaultLimitNOFILE=65000

Postgresql and flask connection

I'm using flask on python3.
Migrate script is working no error from it. Main app is running fine too.
I'm using postgresql when I run migrate everything run fine but then somehow when I go in postgres shell I cannot see any table being created.
modesl.py
from imports import db
from datetime import datetime
from sqlalchemy import ForeignKey
from sqlalchemy.orm import relationship
class UserInfo(db.Model):
__tablename_ = 'user_info'
id = db.Column(db.Integer, primary_key=True)
username = db.Column(db.String(80), unique=True)
email = db.Column(db.String(80), unique=True)
password = db.Column(db.String(100), nullable=False)
posts = relationship('UserPosts', backref='posts')
def __init__(self, username, email, password):
self.username = username
self.email = email
self.password = password
def __repr__(self):
return '{}-{}'.format(self.username, self.email)
As you can see I have two tables there but I just see user_info in my database because I manually created it but the other table I cannot see.
export DATABASE_URL="postgresql:user:password#localhost/registration"
tail /var/log/apache2/error.log
[Fri Oct 07 17:21:56.049888 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line 185, in reraise, referer: http://localhost/login/
[Fri Oct 07 17:21:56.049900 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] raise value.with_traceback(tb), referer: http://localhost/login/
[Fri Oct 07 17:21:56.049919 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context, referer: http://localhost/login/
[Fri Oct 07 17:21:56.049931 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] context), referer: http://localhost/login/
[Fri Oct 07 17:21:56.049951 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute, referer: http://localhost/login/
[Fri Oct 07 17:21:56.049962 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] cursor.execute(statement, parameters), referer: http://localhost/login/
[Fri Oct 07 17:21:56.050034 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] sqlalchemy.exc.ProgrammingError: (psycopg2.ProgrammingError) column user_info.password does not exist, referer: http://localhost/login/
[Fri Oct 07 17:21:56.050088 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] LINE 1: ...nfo_username, user_info.email AS user_info_email, user_info...., referer: http://localhost/login/
[Fri Oct 07 17:21:56.050106 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] ^, referer: http://localhost/login/
[Fri Oct 07 17:21:56.050122 2016] [wsgi:error] [pid 19131:tid 140331236435712] [client 174.58.31.189:34358] [SQL: 'SELECT user_info.id AS user_info_id, user_info.username AS user_info_username, user_info.email AS user_info_email, user_info.password AS user_info_password \\nFROM user_info'], referer: http://localhost/login/
I don't know if I'm setting my connection to the database the right way or if nothing is being created at all .
Thanks.
from flask_script import Manager
from flask_migrate import Migrate, MigrateCommand
import os
import __init__
__init__.app.config.from_object(os.environ['APP_SETTINGS'])
migrate = Migrate(__init__.app, __init__.db)
manager = Manager(__init__.app)
manager.add_command('db', MigrateCommand)
if __name__ == '__main__':
manager.run()
You stated that there are two tables supposed to be present, but I only see one being defined in your models.py file for UserInfo. Do you have UserPosts defined elsewhere in the file as well, or have you only created the relationship to it? If not, you should create a model for it as well.
Another thing to point out is that instead of importing ForeignKey and relationship from sqlalchemy, you should be using db.relationship() and db.ForeignKey()
I can also see that your URL is missing a couple characters. Instead of "postgresql:user:password#localhost/registration" your URL should look like "postgresql://user:password#localhost/registration"
Finally, are you migrating and upgrading with your manage.py file or only migrating? After running python manage.py db migrate you should then follow it with python manage.py db upgrade. The migrate command creates the migration script, while the upgrade command is what executes it and writes your changes to the database.
One last thing to note is that if you change your user_info model while logged into the server and run migrations on those, sometimes there will be discrepancies between what is stored in the session and what is on the database. This can cause the app to crash similar to the error you posted from wsgi, leading me to believe that that may have happened here as well. Make sure to log out before messing with the database, but if that does happen you should be able to just clear your cookies to delete the session and make the error go away.

Permission denied error using datapsuher in CentIOS

Installing/configuring the extension datapusher in a instance of CKAN (version 2.4.1) on CentOS, following the steps of the installation guide from source (production steps), install the datapusher in the default location, configure Apache, etc., starts apache whitin errors with wsgi module:
[Wed Oct 21 17:54:53 2015] [info] mod_wsgi (pid=29799): Starting process 'ckan_gva_dp' with uid=48, gid=48 and threads=15.
[Wed Oct 21 17:54:53 2015] [info] mod_wsgi (pid=29800): Initializing Python.
[Wed Oct 21 17:54:53 2015] [info] mod_wsgi (pid=29804): Initializing Python.
[Wed Oct 21 17:54:53 2015] [info] mod_wsgi (pid=29805): Initializing Python.
[Wed Oct 21 17:54:53 2015] [notice] Apache/2.2.15 (Unix) DAV/2 mod_wsgi/3.2 Python/2.6.6 configured -- resuming normal operations
[Wed Oct 21 17:54:53 2015] [info] Server built: Aug 24 2015 17:50:06
[Wed Oct 21 17:54:53 2015] [info] mod_wsgi (pid=29806): Initializing Python.
But when test datapsher calling to port 8800, try me back a 500 error, with the the following message in the log:
[Wed Oct 21 19:00:55 2015] [info] [client 10.115.100.69] mod_wsgi (pid=29800, process='ckan_gva_dp', application='ckan-gva:8800|'): Loading WSGI script '/etc/ckan/datapusher.wsgi'.
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] mod_wsgi (pid=29800): Target WSGI script '/etc/ckan/datapusher.wsgi' cannot be loaded as Python module.
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] mod_wsgi (pid=29800): Exception occurred processing WSGI script '/etc/ckan/datapusher.wsgi'.
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] Traceback (most recent call last):
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/etc/ckan/datapusher.wsgi", line 10, in <module>
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] web.init()
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/ckan/datapusher/lib/python2.6/site-packages/ckanserviceprovider/web.py", line 50, in init
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] _configure_logger()
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/ckan/datapusher/lib/python2.6/site-packages/ckanserviceprovider/web.py", line 121, in _configure_logger
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] _configure_logger_for_production(logging.getLogger())
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/ckan/datapusher/lib/python2.6/site-packages/ckanserviceprovider/web.py", line 98, in _configure_logger_for_production
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] app.config.get('LOG_FILE'), maxBytes=67108864, backupCount=5)
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/python2.6/logging/handlers.py", line 112, in __init__
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] BaseRotatingHandler.__init__(self, filename, mode, encoding, delay)
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/python2.6/logging/handlers.py", line 64, in __init__
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] logging.FileHandler.__init__(self, filename, mode, encoding, delay)
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/python2.6/logging/__init__.py", line 835, in __init__
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] StreamHandler.__init__(self, self._open())
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] File "/usr/lib/python2.6/logging/__init__.py", line 854, in _open
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] stream = open(self.baseFilename, self.mode)
[Wed Oct 21 19:00:55 2015] [error] [client 10.115.100.69] IOError: [Errno 13] Permission denied: '/tmp/ckan_service.log'
I tried to change the permissions on the folder /tmp (777), add execute permissions to wsgi script, check that all the dependencies specified in requeriments.txt are installed, with the environment for datapusher active, etc., ckan_service.log was empty...
¿Some idea?

Error with Schedulers and Inbound Emails in sugarcrm

We use SugarCRM CE 6.5.16 on Centos 6.5.
I am getting this error :
Wed Apr 9 15:37:10 2014 [10389][1][ERROR] Unable to load custom logic file: include/SugarSearchEngine/SugarSearchEngineQueueManager.php
The real problem is that i dont receive emails from my inbound email.
They are all set up.I added the cron job to the crontab. Well actually I receive some emails, like 3 or 4 from 100. In the schedulers the job status is "running" and last successful run is "Never".
Every other scheduler job has a status "Done" and has last successful run.
I repaired inbound emails , scheduler jobs but with no effect.
The only thing i found is this :
http://suitecrm.com/forum/search?query=SugarSearchEngineQueueManager&searchdate=all&childforums=1
So I commented out this code and i no longer get the error but still I don't receive emails.
I don't know what else to do.
Please help me if you can !Thanks !
EDIT
I found that
"This file is only included in PRO version and it's useless in Community Edition.
Code Fix:
1. Comment code in /custom/Extension/application/Ext/LogicHooks/SugarFTSHooks.php
Do a Fast Rebuild from Administration (index.php?module=Administration&action=repair). This process will rebuild the piece of code that uses the SugarCRM to call inexistent file SugarSearchEngineQueueManager /custom/application/Ext/LogicHooks/logichooks.ext.php"
So I commented out the code and did the rebuild (yeah i did it before but now i know for sure that this file should not be in Sugarcrm CE )
The error doesn't show anymore but my scheduler still stays "running" and nothings happens , except:
When i did this (What Matthew Poer said) , I received 4 emails just like before... so something is causing a problem.
delete from job_queue where scheduler_id = 'THE_SCHEDULER_ID';
update schedulers set last_run = subdate(now(),360) where id = 'THE_SCHEDULER_ID';
EDIT 2:
This is from php error_log
[Sun Apr 13 03:34:27 2014] [notice] Digest: generating secret for digest authentication ...
[Sun Apr 13 03:34:27 2014] [notice] Digest: done
[Sun Apr 13 03:34:33 2014] [notice] Apache/2.2.15 (Unix) DAV/2 mod_nss/2.2.15 NSS/3.14.0.0 Basic ECC PHP/5.3.3 mod_ssl/2.2.15 OpenSSL/1.0.0-fips mod_wsgi/3.2 Python/2.6.6 mod_perl/2.0.4 Perl/v5.10.1 configured -- resuming normal operations
[Sun Apr 13 12:22:52 2014] [error] [client 122.155.18.51] File does not exist: /usr/share/phpMyAdmin/translators.html
[Sun Apr 13 13:45:31 2014] [error] [client 122.155.18.51] File does not exist: /usr/share/phpMyAdmin/translators.html
[Sun Apr 13 15:43:39 2014] [error] [client 66.249.66.74] File does not exist: /opt/otrs/var/httpd/htdocs/js/js-cache/ModuleJS_784dc12bf89d72db064caa6e8690168b.js
[Sun Apr 13 15:43:40 2014] [error] [client 66.249.66.74] File does not exist: /opt/otrs/var/httpd/htdocs/skins/Customer/default/css-cache/CommonCSS_b1f924c426a0e1a9f1553197a2ce25a4.css
[Sun Apr 13 15:43:41 2014] [error] [client 66.249.66.74] File does not exist: /opt/otrs/var/httpd/htdocs/js/js-cache/CommonJS_7f98ddff2f339e3b515f7901d82600bb.js
[Mon Apr 14 11:09:04 2014] [error] [client 192.168.10.1] PHP Warning: file_get_contents(): php_network_getaddresses: getaddrinfo failed: Name or service not known in /usr/share/phpMyAdmin/version_check.php on line 16, referer: http://support.expert-m.net/phpmyadmin/main.php?token=d2e60372f8b5d6d53f0c3c80a536be27
[Mon Apr 14 11:09:04 2014] [error] [client 192.168.10.1] PHP Warning: file_get_contents(http://www.phpmyadmin.net/home_page/version.json): failed to open stream: php_network_getaddresses: getaddrinfo failed: Name or service not known in /usr/share/phpMyAdmin/version_check.php on line 16, referer: http://support.expert-m.net/phpmyadmin/main.php?token=d2e60372f8b5d6d53f0c3c80a536be27
[Mon Apr 14 12:45:25 2014] [error] [client 178.235.72.68] client sent HTTP/1.1 request without hostname (see RFC2616 section 14.23): /w00tw00t.at.ISC.SANS.DFind:)
This is from the logs folder of SugarCRM, error.log
[Mon Apr 14 08:58:59 2014] [error] [client 192.168.10.1] PHP Notice: Undefined index: 8854a79c-6171-036c-e7df-534548e8bc81 in /var/www/sugarcrm/public_html/modules/Emails/EmailUIAjax.php on line 879, referer: http://sugarcrm.support.expert-m.net/index.php?module=Emails&action=index&parentTab=All
[Mon Apr 14 08:58:59 2014] [error] [client 192.168.10.1] PHP Notice: Undefined index: 8854a79c-6171-036c-e7df-534548e8bc81 in /var/www/sugarcrm/public_html/modules/Emails/EmailUIAjax.php on line 880, referer: http://sugarcrm.support.expert-m.net/index.php?module=Emails&action=index&parentTab=All
[Mon Apr 14 11:22:17 2014] [error] [client 192.168.10.1] PHP Notice: Undefined index: 8854a79c-6171-036c-e7df-534548e8bc81 in /var/www/sugarcrm/public_html/modules/Emails/EmailUIAjax.php on line 879, referer: http://sugarcrm.support.expert-m.net/index.php?module=Emails&action=index&parentTab=All
[Mon Apr 14 11:22:17 2014] [error] [client 192.168.10.1] PHP Notice: Undefined index: 8854a79c-6171-036c-e7df-534548e8bc81 in /var/www/sugarcrm/public_html/modules/Emails/EmailUIAjax.php on line 880, referer: http://sugarcrm.support.expert-m.net/index.php?module=Emails&action=index&parentTab=All
[Mon Apr 14 11:24:47 2014] [error] [client 192.168.10.1] File does not exist: /var/www/sugarcrm/public_html/favicon.ico
I didn't paste all the info from the logs. There is more but the errors are repeating.
The file include/SugarSearchEngine/SugarSearchEngineQueueManager.php won't exist in your system because it's a Pro+ feature.
To reset a scheduler entry that got "stuck," delete the scheduler information from the job queue in the database and reset the last_run value. Find the ID of the scheduler from the URL within SugarCRM or by select id,name from schedulers. Once you have the ID of this scheduler, run this two queries:
delete from job_queue where scheduler_id = 'THE_SCHEDULER_ID';
update schedulers set last_run = subdate(now(),360) where id = 'THE_SCHEDULER_ID';

Why is GoogleBot interested in [index.php] when my root redirects to [/en/home]?

for the past months, googleBot has been hitting a file that does not exist anymore on my site [index.php] as all the routing to the proper home pages in the proper languages is handled via apache rewrite rules in the htaccess.
Ans to, I commented out my .htaccess the DirectoryIndex index.php rule
RewriteEngine on
RewriteBase /
Options +FollowSymLinks -Indexes -ExecCGI
# DirectoryIndex index.php (not needed anymore, index.php doesnt exist)
# DirectoryIndex /en/home (should it be set to this now??)
Currently, Everything works sublime: the http://website.org root is redirected instantly to /en/home via 301 permanent rediret!
But
66.249.67.142 / == crawl-66-249-67-142.googlebot.com is hitting my site again and again trying to read index.php, which does not exist. What should I do??
A sneak peak into the endless error log file with such entries (poor googlebot i thought it might be more intelligent...)
[Fri Mar 04 20:48:30 2011] [error] [client 66.249.66.177] File does not exist:
/var/www/vhosts/site.com/httpdocs/index.php
[Fri Mar 04 20:58:59 2011] [error] [client 66.249.66.177] File does not exist:
/var/www/vhosts/site.com/httpdocs/index.php
[Fri Mar 04 21:00:18 2011] [error] [client 66.249.67.142] File does not exist:
/var/www/vhosts/site.com/httpdocs/index.php
[Fri Mar 04 21:01:05 2011] [error] [client 66.249.66.177] File does not exist:
/var/www/vhosts/site.com/httpdocs/index.php
[Fri Mar 04 21:12:28 2011] [error] [client 66.249.66.164] File does not exist:
/var/www/vhosts/site.com/httpdocs/index.php
[Fri Mar 04 21:27:30 2011] [error] [client 66.249.68.115] File does not exist:
/var/www/vhosts/site.com/httpdocs/index.php
Someone linked to index.php, so Google is trying to follow it.
Do a rewrite from index.php to /en/home, and you'll be golden.
E: Also, DirectoryIndex can't be a Path, AFAIK. It just tells the server which file in a directory should be served if not specified otherwise.
/ and /index.php are separate resources as far as anything accessing your site through HTTP is concerned. Just because you are redirecting /, it doesn't mean anything if Google has seen links to /index.php before.
Just redirect /index.php to /en/home in the same way as you are redirecting /.