| Website Statistics are compliant with the rules and regulations as set by industry standards for web log processing. |
|
Website Log Analysis And Reporting
Logfile Transfer And Processing

1. Webserver Log Files
Logfiles that are created on a webserver when users browse websites are normally stored on the servers local disk.
The webserver can be configured to log specific information about web page requests - the ANL Website and Log Analysis reporting system makes use of
the following information obtained from these log files.
Date, Time, Webserver, Host (Website) Name, Client IP, User Agent
An important point is that as this system uses webserver log files there is no need to include hidden images or embedded tags
within web pages as with other reporting systems. Your website can be fully reported on without making changes to any files - the only
requirement is that the webserver is configured to output the correct log format.
2. Log File Transfer
The log files are transferred via FTP to ANL servers. We can supply scripts to automate this process for all types of web server and
operating system. Before the files are transferred they are first zipped up to reduce file size and therefore bandwidth consumption - as log files
are text only zip compression offers approximately 90% reduction in file size, taking very little overhead on the webserver.
Log files may be transferred at different time intervals :
hourly, daily, monthly or when a log file reaches a certain size. Note : Microsoft IIS4 does not support hourly rotated logfiles.
3. FTP Servers
The ANL FTP servers run on Intel ISP2150 dual processor servers running Debian GNU/Linux.
This platform offers reliable connectivity and high performance. Access to the FTP servers is password protected and
restricted by source IP address ensuring only those who need it have access.
4. Custom Perl Script
A custom built Perl Script has been developed to process raw log files into useful information. This script adheres to
the recommendations and regulations made by the auditing authority ABC Electronic. Log files uploaded via FTP are processed
almost immediately and the information extracted from them is inserted into a MySQL database store for up to the minute reporting.
5. MySQL Database Platform
The MySQL database platform offers reliable and fast database querying across a large data set - ideal for reporting on
web site statistics. Web site data is kept by default for one year - if a customer needs to keep data for longer periods
this requirement can be met. A number of database tables hold a range of information processed by the Perl script in an
easy to query structure.
|
|