Navigation
Home Page
Product Overview
Log Processing
Reporting Tool
Standard Reports
Advanced Reports
Word Report Tool
Register Interest

Useful Links
Debian
MySQL
Remote Data Services
Office Web Components

Customer Login
Report Database
Username
Password

Website Statistics are compliant with the rules and regulations as set by industry standards for web log processing.
Website Log Analysis And Reporting

Logfile Transfer And Processing




1. Webserver Log Files
Logfiles that are created on a webserver when users browse websites are normally stored on the servers local disk. The webserver can be configured to log specific information about web page requests - the ANL Website and Log Analysis reporting system makes use of the following information obtained from these log files.

Date, Time, Webserver, Host (Website) Name, Client IP, User Agent

An important point is that as this system uses webserver log files there is no need to include hidden images or embedded tags within web pages as with other reporting systems. Your website can be fully reported on without making changes to any files - the only requirement is that the webserver is configured to output the correct log format.

2. Log File Transfer
The log files are transferred via FTP to ANL servers. We can supply scripts to automate this process for all types of web server and operating system. Before the files are transferred they are first zipped up to reduce file size and therefore bandwidth consumption - as log files are text only zip compression offers approximately 90% reduction in file size, taking very little overhead on the webserver.

Log files may be transferred at different time intervals : hourly, daily, monthly or when a log file reaches a certain size. Note : Microsoft IIS4 does not support hourly rotated logfiles.

3. FTP Servers
The ANL FTP servers run on Intel ISP2150 dual processor servers running Debian GNU/Linux. This platform offers reliable connectivity and high performance. Access to the FTP servers is password protected and restricted by source IP address ensuring only those who need it have access.

4. Custom Perl Script
A custom built Perl Script has been developed to process raw log files into useful information. This script adheres to the recommendations and regulations made by the auditing authority ABC Electronic. Log files uploaded via FTP are processed almost immediately and the information extracted from them is inserted into a MySQL database store for up to the minute reporting.

5. MySQL Database Platform
The MySQL database platform offers reliable and fast database querying across a large data set - ideal for reporting on web site statistics. Web site data is kept by default for one year - if a customer needs to keep data for longer periods this requirement can be met. A number of database tables hold a range of information processed by the Perl script in an easy to query structure.