SARG ChangeLog Mar-03-2008 Version 2.2.5 - new fix to the script insertion vulnerability via user-agent report. Javascript can still be executed via e.g. the "" scheme Thanks to Alin Rad Pop, Security Specialist, Secunia, Denmark Mar-02-2008 version 2.2.4 - security issues can be exploited to execute arbitrary code when sarg is used with malicious input files. The vulnerability within the processing of the useragent.log is rather critical, as this can be exploited by passing a long user agent string when browsing via a squid proxy. the manipulated GET request in the access log would not be accepted by squid, so that file has to be specially crafted. Thank you to L4teral l4teral@gmail.com - French language fixed. Thanks to Nicod - Fixed: Segfault in x86_64 Jan-02-2007 version 2.2.3.1 - fixed -m option to show all the used tags - date period invalid in download reports - wrong results when userid contain '%20' character - previous reports info wrong in index.html Dez/23/2006 Version 2.2.3 - gd graph font change from FreeSans.ttf to DejaVuSans.ttf - minor fixes when only denied records in access.log file. - ulimit tag changed. If you run sarg with a low privilege user, set to 'none' to disable ulimit. Thanks to Jorge Morgado - Russian_UTF-8 language fixed by Igor Ageikin - realtime_unauthenticated_records tag changed to show by default. - chmod 755 in sarg-php due to errors in rpmbuild. Thanks to Davide Madrisan - when the keyword "anonymous" is used in squidGuard.conf, Sarg does not find the log-files anymore. Thanks to Daniel Vogel - after reading the squidGuard configuration, the data read from the usertab file was corrupted. Thanks to Daniel Vogel - milisec values showed as bytes. Thanks to Carlos - with squidGuard, you can log groups in only one log file. We must parse each log files only one time. Thanks to Christophe BADINA - error message(removetmp) Cannot open /tmp/sarg_tmp/../general when sending report by email. Thanks to Peter Volkov - incorrect off_t size in printf. In FreeBSD off_t is 64bit long long, but sarg always use %d to display off_t in log processing. This cause garbage while reading log files on a freebsd, and possible crash. Thanks to Alex Samorukov - squid24 on/off tag added in sarg.conf to implement compatibility if using squid <= 2.4 and using squid common logs. Thanks to Valter Dal Bo - exclude_hosts and some code errors fixed by Alexander Kozlov . Many thanks. - temporary file names changed to sarg-... to avoid conflicts with usernames. Thanks to Ukrainian Elephant - SARG support Japanese wordset but not support charset. submited by anonymous at sourceforge.net Many thanks. - support for utf-8 character set added by Peter Warasin . Many thanks. - if all the data is at the hour each day, totaliza_day() treates it all as being on the last day. This is observed for users which only download via a cron job at the same time each day. Now the date and time will be checked to see if changed. Thanks to Ian Dall - greport_day() doesn't add the volume for the first hour of each day to the total. Thanks to Ian Dall - Russian_koi8 and Russian_windows1251 languages updated by Stas Degteff . Many thanks - realtime reporting is sorted by URL, and not by Date/Time. Thanks tp Puce-Xcit Aug/29/2006 Version 2.2.2 - malloc test implemented to avoid high-memory consuming. Thanks to Rodrigo Rubira Branco - Czech UTF8 language added by Josef Karliak - fixed: parsed mismatch in realtime_access_log_lines and access_log_lines tags. Thanks to Kuznetsov Andrey - changed: realtime report sort changed by date/time Thanks to Leonardo Buonsanti - GD minor fixes added. - bug fixed. *** buffer overflow detected ***: sarg terminated in Fedora Core 5 when using -D FORTIFY_SOURCE in gcc or in kernel. May/19/2006 Version 2.2.1 - iconv problems fixed in Freebsd and Slackware. Thanks to Grigory Trenin . - new word added to languages: Topuser - missing fclose fp-in in css.c Thanks to Renato Botelho . - index.c fixed. Missing -r in reverse sort. Thanks to Fernando Lemes da Silva - wrong values in columns in-cache and out-cache. Thanks to Hugo P S Costa May/17/2006 Version 2.2 - sarg ported to 64 bits. Thanks to Antonio F. Zago to share your Fedora Core 5 64 bits with me. - fixed conflict types for 'saverecs2' in .configure - fixed no index.html when lastlog tag is greather then 0, caused by some debug messages. - removed some development debug message - user_limit_block script added to block users when limit exceeded - fixed wrong sort in index.html - removed '+' argument to sort utility. Thanks to Julio Cesar Covolato - fixed "file too long" messages when using long_url Thanks to Fabio Lo Votrico - fixes and improvements from Oleg - Tanks. . fprintf faster than sprintf+fputs (fixed in some places); . strcpy+strcat is faster than sprintf (fixed in some places); . unused variables removed; . fixed headers look and feel (); . fixed word 'BYTES' localisation for datetime user report; . fixed corrupted top header on index, denied, download and tt-reports; . fixed "No" table header in topsites; . fixed user report table look; . fixed floating point exception on long url (added checks for division by zero); . fixed incorrect long url view; . fixed too wide table entries in user report by adding url_limit internal parameter in html.c (default 40); . fixed charset.c file (was in MS-DOS text format); . also included all previous fixes by other people (from datafile.patch and lastlog.patch files). Nov/29/2005 version 2.1 - index_tree tag added. Look at TAG: index_tree in sarg.conf file default is file - old format. - realtime report added. sarg -r option Look at these tags ion sarg.conf file: TAG: realtime_refresh_time num sec TAG: realtime_access_log_lines num TAG: realtime_types: GET,PUT,CONNECT,ICP_QUERY,POST TAG: realtime_unauthenticated_records: ignore|show - garbage in topuser report with unitialized variable. Thanks to Craig Brockmeier - memory leaks caused by a wrong variable size Fixed by Klaus Singvogel . Thanks. - ignoring users with '.' in password file. Thanks to Emerson Valdir Pellis - error with "resolve_ip" with "user_authentication yes" Fixed by Grigory Trenin . Thanks. - long url causing fault. Thanks to Vassily Andin - hanging on a log file containing space. Thanks to Fabio Lo Votrico - bug fixed in squidguard report module - squidguard_ignore_date on|off tag added to sarg.conf file You can ignore the squidguard log record date if outisde of date range in squid access.log file. - alternate squidguard log added using -L option on sarg command line. Thanks to Dave Karlson - fixed malloc withou free. - datafile-url ip|name added to sarg.conf file - saves ip address or name in url when using datafile tag. Thanks to Calvin Muller - wronk link point in Generated by sarg-2.. Thanks to Markus Hoffmann - Russian_UTF-8 language added by Alex Deiter Aug/04/2005 version 2.0.9 - dansguardian_report_limit missing in sarg.conf file. - ntlm domain+user format added. - index date sort fixed by Olivier JAVAUX. Thanks - Improve broken record detection Thanks to Artem Korneev - sort open failed causing an empty topuser report - sarg losslessly size optimized images Thanks to Tonda Míżek and Luigi Gangitano. - sarg calling sort without quoting filenames Thanks to Luigi Gangitano. - download_report_limit tag added. Thanks to Leonardo Rodrigues - logo css class defined but never used. Thanks to Roger Favero May/29/2005 version 2.0.8 - verdana.ttf font removed to avoid patent infringement issues. Now sarg uses a GPL FreeSans font from http://savannah.gnu.org - ISA report with wrong date in date/time report. Thanks to Richard Berndt - connect records ignored when using emulate_http_log on in squid.conf file. Thanks to Dusan Woletz - bug that prevents the correct usage of switch -d when using an "emulate_httpd_log on" logfile and some performance improvements added. Thanks to Filippo Grassilli - Spanish language fixed by José Luis Hernández López. Thanks. - url variable size changed to acomodate big urls with coded symbols and some minor changes in util.c file. Thanks to Oleg - download suffixes improved by Oleg . Thanks. Now sarg uses these suffixes: 7z,ace,arj,avi,bat,bin,bz2,bzip,cab,com,cpio,dll,doc,dot,exe,gz,iso, lha,lzh,mdb,mov,mp3,mpeg,mpg,mso,nrg,ogg,ppt,rar,rtf,shs,src,sys,tar, tgz,vcd,vob,wma,wmv,zip May/02/2005 version 2.0.7 - DansGuardian report added. Thanks to Adolfas Kupliauskas for the access.log - Slovak language added by Dusan Woletz Thank you - wrong usertab user on topuser report. Thanks to Marcos Favoretto - ntlm_user_format added to sarg.conf. Now you can choose the following formats for the username on reports: user|domainname+user Suggested by Roger Favero - exclude_users ignored in some situations. - Fixes by Sapon Oleg from Russia: . there are two equal lines about Evren Yurtesen in CONTRIBUTORS file. . Internationalisation of SARG user graph added, using iconv function, which is presented only in Linux, so I add required #ifdef and other stuff to clean compile code on other platforms. . Fixed two issues: - '?' symbol problems for apache and other cgi-supporting web server which doesn't support '?' symbol in links (all of them interprete this like parameter to cgi script); - some good optimization to all three similar cicles in these files by reducing false checks in 'if ...' strings. . Fixes segfault, produced by inproper use of strncpy functions, look - strncpy doesn't copy leading '\0' symbol! . Just localisation support for repday report. . Support usertab IP->USERNAME change in siteuser report. . Just proper Russian koi8 localisation. Apr/22/2005 version 2.0.6 - Greek language by Antonis Maglaras Thank you. - time period added to -t option. Now you can use -t HH-HH, HH:MM-HH:MM - support to isa proxy 2004 log added. Thanks to William da Rocha Lima - French language fixed by Alexey Znamerovskiy Thanks - internal LC_ALL=C removed to avoid errors on Solaris. Thanks to Hraska, Frantisek - non authenticated records removed from Topuser report. Thanks to Brian - Compilation error on FreeBSD > 5 - log.c:645: error: `RLIMIT_OFILE' undeclared - Sarg abbreviation values improved. Mar/21/2005 version 2.0.5 - fixed: some changes to avoid segmentation fault. - fixed: some changes to avoid compilation errors on freeBSD. - fixed: exclude_hosts not excluding correctly. Feb/17/2005 version 2.0.4 - exclude hosts not excluding correctly. Thanks to Oleg - download report showing jpeg files. - support to Microsoft isa proxy log files added. Thanks to Trankov Vladislav - fixed: error when using relative paths in -o and -w options. Just absolute paths can be used now. Thanks to Andreas Grosse - fixed: segfault fix in vrfydir() in util.c Prevent buffer overflow in subs(); replace one constant with sizeof() in my_lltoa(). vrfydir(): fix segfault if sub-directory "images" is not exists function builddia() don't check the parameters. Result: segmentation fault in some cases. Thanks to Stas Degteff stas_degteff@users.sourceforge.net for the fixes. - fixed: wrond date period in squidguard_log when using european date format. Thanks to Guenther Mair - ulimit tag added on sarg.conf to avoid "Too many open files" error. Thanks to Paulo Pires Feb/02/2005 verion 2.0.3 - squidguard parse logs method changed. Thanks to Joao Mendes Thanks to Guenther Mair - wrong results in -v option. - fixed: error when using -u (include user) Thanks to Bochkarev Vladimi - export LC_ALL=C will be issued before sort to avoid high cpu usage Nov/22/2004: version 2.0.2 - grepday with invalid font path. Thanks to Marcelo Ricardo Leitner - -v option added to display Sarg version on console - Segmenation fault caused by an unclosed file. Thanks to Pustovalov Leonid - SquidGuard log formats added. Thanks to Kolotov Alexandr - time field added to topsites report Thanks to Miles Roper - fixtime function with wrong definition, changed to long long Thanks to Valery from Russia - Solaris 9 compiling error: error: conflicting types for 'my_mkdir' Thanks to Brad Larden - segfaults if the denied report is disabled in sarg.conf. Thanks to Filippo Carletti - reading performance improved by Francesco Perrillo Thanks - Russian sarg-php translation added. Thanks to Michael Stepanenko Oct/04/2004: version 2.0.1 - configure error with no gd installed. - graph with no text when using --enable-sysconfdir - graph day incorrect when using dd/mm/yy date format - show_sarg_logo yes|no added - site_user_time_date with wrong patch. Thanks to Ricardo R. Hoffmann Sep/29/2004: - version 2.0 - Internal/External css implemented - User authentication access (htaccess) implemented - large file support added - Report limits implemented - Download report implemented - Sarg logo by Osamu Matsuzaki added. - Internal mkdir added to easy port to various plataform. - long url now show only accessed site and module name. - now you can add a user report url to a flat file to be blocked by some Squid acl. Request by Francesco Collini - remove temporary files, if already exist, to avoid conflits with a previous sarg process.. Thanks to Renato Leon - squidGuard improved - now only records with the same period from access.log will be in squidGuard report. - squidGuard limit report - now you can save some urls in squidGuard db using sarg-squidguard PHP utility. bug fixed: fault caused by rewinddir after closedir. Thanks to Lucas Bocchi and to Freek Fixed: - missing tags in all HTML pages - missing tag in some HTML pages - missing DOCTYPE in all HTML pages - grammar in man page - URL Links to SourceForge http://sarg.sourceforge.net/ Added: - Included more detailed information in man the page Thanks to Billy Newsom of U.S. To Do: - There are still major validation problems in the HTML generated Apr/25/2003: - fixed: - link error to denied site in squidGuard report - resolve name error in squidGuard report - some fixes to HPUX. Thanks to Miles Roper - index_sort_order tag don't work correctly. - too many open files fixed. Thanks to Francesco Perrillo - Ukrainian_windows1251 included in sarg.conf file - exclude_string don´t work correctly. Thanks to Modric Kristijan Mar/17/2003: - Release 1.4 Added: Now you can choose the fields that will be in User Reports. Look at user_report_fields tag in sarg.conf file Implementation requested by Daniel T. Joye Added: Now sarg saves the processed log in a sarg format after parsing the squid log file. This allow futures sarg reprocess and data will be smaller than Squid the log files Look at parsed_output_log directory and parsed_output_log_compress tags in sarg.conf file Implementation requested by Joe Cooper . Many thanks for the donation. Added: Now sarg can display the report values in abbreviation format. Look at displayed_values in sarg.conf Added: Ukrainian_windows1251 language by Roman Vynar Thank you. Added: Catalan language by Andreu Sanchez Thank you. Nov/16/2002: - Fixed: squidGuard report fail with non authenticated users. Thanks to Dan Ratzlaff Fixed: Turkish language by Evren Yurtesen . Thanks Fixed: English language by Luigi Gangitano . Thanks Fixed: "CONNECT" average values are incorrectly calculated. Arvids . Thanks Oct/15/2002: - Added: sarg man page created by Luigi Gangitano Added: Reading statistics, show_read_statistics tag Added: Index sort order. See index_sort_order tag Added: squidGuard report - squidguard_log_path tag Added: show_sarg_info on report bottom optional - show_sarg_info tag Changed: gzipped file will be decompressed using zcat bzipped file will be decompressed using bzcat Changed: new sort routine added. Changed: strsep changed to getnumlist function by Robert Tiismus Jun/02/2002: - Added: save the results in a flat file to use to populate some database. Look at these tags in sarg.conf file: TAG: datafile file TAG: datafile_delimiter ";" TAG: datafile_fields all Added: logic to detect a broken record in access.log file and ignore it. Added: now you can select the records to be processed by week and/or time using these tags in sarg.conf file: TAG: weekdays TAG: hours Thanks to Robert Tiismus from Institute of Physics, University of Tartu, Estonia. , and for the repday.c improvements. Apr/03/2002: - bug fixed: cannot create temporary file when url contain '/' and using long_url Thanks to Enrico Sorge Dez/10/2001: - Added: sarg now shows statistics when readding the log file if running with -x option Dez/05/2001: - bug fixed: - loop proccess when using "tmp" chars in usernames Thanks to Jasper vd Heijden new tag added: show_successful_message yes Show "Successful report generated on dir" message at end of process. Requested by: Wendell Schubert Mauricio Felizardo dos Santos bug fixed: core dump when removing auth_failures report from report_type tag. Thanks to Leonardo Rodrigues bug fixed: core dump with a big number of users. Thanks to Zverev, Alexandr V. new tags added: topuser_fields topuser_num Now you can choose which fields must be in Topuser report and how many users. Requested by Hidde Beumer bug fiexed: auth_failures report missing Thanks to Clary Harridge Polish language added by Wszebor Boksa Thank you. Romanian language added by Adi Cretu Thank you. Jul/03/2001: - new report added: site/user/date/time Now report_type tag has the following default setup: report_type topsites sites_users date_time denied auth_failures site_user_date_time - bug fixed - error when using squid-ntlm authenticator (domain\user) Thanks to Jakob Curdes - ignoring changes in report_type tag - Site&Users report with users shifted down one row. Thanks to Jason Urkow - some temporary files not removed. - site/user/date/time report without and May/30/2001: - bug fixed: - user table garbage - chmod 644 removed from makefile - ignoring first user in usertable - ignoring users names with dots (".") Thanks to Daniel Malmgren - same values for connect and bytes fields in reports on Solaris 8 Thanks to Craig Brockmeier New tag added: user_invalid_char "&/" To avoid core dumps, records that contain invalid characters in userid will be ignored by Sarg. New tag added: privacy yes|no privacy_string "***.***.***.***" privacy_string_color blue In some countries the sysadm cannot see the visited sites by a restrictive law. Using privacy yes the visited url will be changed by privacy_string and the link will be removed from reports. Requested by Diaolin (Natali Giuliano) New tag added: include_users "user1:user2:...:usern" Reports will be generated only for listed users. exclude_string "string1:string2:...:stringn" Records from access.log file that contain one of listed strings will be ignored. Requested by Michael Koptyaev Apr/02/2001: - implementation of --enable-bindir and --enable-sysconfdir in configure script. Thanks to Sergei Dushenkov - bug fixed: getword excessive long string detection function fixed. Thanks to Junghausz Norbert - bug fixed: wrong charset for windows-1251 and koi8 Russian languages. Thanks to Alexey Zhigayev - bug fixed: - Help page (-h) is empty because at start (log.c) program doesn't load definitions to text[][] array. - Definitions for Russian language doesn't have last 2 lines. - Definitions of Charset field for Russian language is not so correct. Better is 'windows-1251' or 'koi8-r' - I think in topuser.c the definition of wheader[] is too short for words on some languages - Initialization and use of variables TopuserSortField and TopuserSortOrder is mismatch Thanks to Alex Voronin - bug fixed: core dump with big user table. Thanks to Jorge Cuellar Martinez - Latvian languages by Juris Valdovskis Thank you Mar/22/2001: - Now te user can choose the language using the language TAG in /usr/local/sarg/sarg.conf file. There is no more --enable-language in configure script. - New report added: Autentication Failures Requested by Sergei Dushenkov - NONE/400 (bad request) is excluded by default (/usr/local/sarg/exclude_codes) - Now sarg support big numbers (64 bits) in any platform. - Date/Time report now use bytes or elapsed time as specified in date_time_by tag in sarg.conf Requested by Inters - bug fixed: sites&users report sorted on the User field rather than the Site field Thanks to Simon Bryan - sites&users report was changed. - Russian_windows125 language fixed. Thanks to Dima I. Allaverdov (rasa) - bug fixed: getconf was catching a wrong value in replace_index tag Thanks to vrush_22@softhome.net - bug fixed: per_user_limit file with duplicate users. - Russian languages fixed by Nikolai V. Ivanyushin . Thank you. - charset TAG added to sarg.conf file. The following charsets are avaiable: Latin1 (West European), Latin2 (East European), Latin3 (South European) Latin4 (North European), Cyrillic, Arabic, Greek, Hebrew Latin5 (Turkish), Latin6 (Nordic) Requested by Nikolai V. Ivanyushin - configure now accept only two options: --enable-bindir - where sarg binary will be saved --enable-sysconfdir - where the configuration directory is Mar/09/2001: Sqmgrlog has gained a new name: SARG - Squid Analysis Report Generator. Many people have asked me about why sqmgrlog. I really don´t know. No inspiration I think. SARG was suggested by an user from Philippines, but, I lost his email and don´t remember his name. Thank you anyway. sqmgrlog ChangeLog Feb/06/2001: Version 3.0 released: - Denied report added. Request by Jason Staudenmayer - User table added. You can override your userid or IP Address with a real user name. TAG usertab added to sqmgrlog.conf - Now you can have the long url in reports TAG long_url added to sqmgrlog.conf - Now you can choose the report types TAG report_type added to sqmgrlog.conf - sqmgrlog.conf file now will be in 644 mod. Request by Michail Vidiassov - sqmgrlog coredumps if there is a very long line in the config file. Thank you to Michail Vidiassov - Url parser changed to get connect records from a better way Thanks to Sergey Erokhin - Michail Vidiassov made gcc -Wall ... happy on FreeBSD 4.1 Thank you - Russian_Koi8 language fixed by Andrew Okhmat . Thank you. Maks Nefedchenko . Thank you. - Russian and Bulgarian language fixed by Nikolai V. Ivanyushin Nov/09/2000: Two patches form Brad Guillory added: 1. max-elapsed tag added to sqmgrlog.conf file: # TAG: max_elapsed milliseconds # If elapsed time is recorded in log is greater than max_elapsed use 0 for elapsed time. # Use 0 for no checking # #max_elapsed 0 # 8 Hours max_elapsed 28800000 2. day report (the one that looks like a calendar) changed: Every minute that a request is logged your time is incremented by the smaller of 1 minute or the total time for the requests. Thank you Brad. Brad Guillory is the newest sqmgrlog contributor. Changed: sort now compare according to arithmetic value. Jul/11/2000: Dutch language fixed by Pieter Kooistra Thank you. Changed: Russian_koi8 changed to Russian_Koi8. Thank you to Eugene AKA Kevin Kevin Slightly changed Czech language Added: TAG: replace_index Replace "index.html" in the main index file with this string Vladimir Smelhaus Bug fixed: For some reason, Squid occasionally logs a blank line. Running sqmgrlog against a log containing a blank line causes sqmgrlog to take 99+% CPU Thanks to Giese, Bill Added: now every squid code that contain the MISS word will be counted as out cache. Thanks to Kostya Panov Jun/09/2000: Bug fixed: abnormal end if userid contain ';' Thanks to Victor Feoktistov Japanese language fixed by Akira Kitamura Takamatsu-City Kagawa Japan Bug fixed: Wrong date when setting date_format u in sqmgrlog.conf file Thanks to Dale Perkel , Marcio Rodrigo Bordignon Mar/15/2000: Japanese language added by Akira Kitamura Takamatsu-City Kagawa Japan Thank you. Serbian language added by Radovan Drobnjakovic Thank you. Bug fixed: wrong sort field when lower case used in sort tags. Thaks to Scott Larsen and to WOLETZ, Dusan Abuse report removed. Changed: report1_sort_field TAG in sqmgrlog.conf changed to topuser_sort_field Changed: report2_sort_field TAG in sqmgrlog.conf changed to user_sort_field Added: topsites sort field options added: # TAG: topsites_sort_order CONNECT|BYTES A|D # Sort for topsites report, where A=Ascendent, D=Descendent # #topsite_sort_oder CONNECT D Implementation requested by Michael G. Koch Feb/26/2000: Bulgarian-windows1251 language added by Ivan Minchev . Thank you. French language updated by Olivier Rousselot Thank you. Feb/15/2000: SmarfFilter report added. Implementation requested by Andrew Bradshaw Bug fixed: files created with 09Feb2000-09022000 instead 09Feb2000-09Feb2000 Thanks to Andy Parfenov Changed: ignore records with HTTP/0.0 string. Implementation requested by Bernd Kossmann Changed: some code added to ignore broken records in access.log file Bug fixed: removing old file with lastlog dont work. Thanks to Evren Yurtesen Jan/20/2000: Indonesian language added by V Gatut Harijoso Thank you. Fixed: change in conf.h to compile on OpenBSD 2.6 system. Thanks to Kenneth Ingham Fixed: small bug, which fills the "periodo" with "01Jan2000-20000101" instead of "01Jan2000-01Jan2000". Thanks to Schlosser, Carsten ECOFIS Fixed: After calling system function malloc, variable excludecode have some symbols inside (excludecode wasn't zeroed). Thanks to Andrew Katkov Dec/29/1999: Czech language added by Milos Prudek Thank you. Russian-windows1251 language added by Dima I. Allaverdov Thank you. Changed: Russian language changed to Russian_koi8 language. Bug fixed: Sites&Users report dont resolve ip address. Thanks to Pavel Jezek Nov/29/1999: Bug fixed: DENIED word translated to another language never printed. Thanks to Rodolphe SIBERT New report added: Sites & Users Implementation requested by Rodolphe SIBERT Added: The date format now also has the option "w" for week. The report is then 1999.47-1999.47 for instance. Implemented by Seth Mos , thank you for the patch. Dutch language added by Seth Mos Thank you. Added: new tag on sqmgrlog.conf, named user_ip, for setting a system wire -p, use ip address instead userid. Implemented by Carlo Marcelo Arenas Belon Thank you for the patch. Added: new tag on sqmgrlog.conf, exclude_codes pointing to a file with codes to be ignored by sqmgrlog. Eg.: NONE/400 Implementation asked by Doug Burks Sep/28/1999: Bug fixed: -split and -convert dont work with multiples -l options. Thanks to G. Kelana Sudibyo" Bug fixed: Bytes and Average corrupted in index.html after second execution. Thanks to Rob Glasser Sep/13/1999: Bug fixed: get wrong access.log file when using access_log in sqmgrlog.conf file. Thanks to Michael G. Koch Sep/10/1999: Spanish language added by Leonardo A. D'Angelo Thank you. New report added: topsites. This report show the top n sites accessed. You can set the top num sites in topuser_num tag in sqmgrlog.conf file. Bug fixed: wrong userid when using Samba authenticator. Thanks to klaubert@bcb.gov.br (Klaubert Herr da Silveira) Changed: -v option removed. No more suport for Squid-1 log format. Thanks to Nik Oxley Aug/18/1999: New fields added to sqmgrlog.conf: - lastlog n With lastlog you can tell to sqmgrlog to remove old reports files. Usage: lastlog 0 - no remove nothing lastlog 10 - maintain only the last 10 reports Implementation requested by Evren Yurtesen Thank you for your help. - remove_temp_files yes|no Remove temporary files: geral, usuarios, top, periodo from root report directory. Impementation requested by Fred Pacquier - index yes|no|only Usage: index yes - will genereate the main index.html in reports index no - dont generate the main index.html in reports index only - generate only the main index.html in reports Implementation asked by Fred Pacquier - overwrite_report yes|no If yes and the report already exist for that date, the reports will be overwrited. If no and the report alread exist, that report will be renamed to filename.n, filename.n+1 Implementation requested by Eugeny Kuzakov - records_without_userid ignore|ip|everybody What can I do with records without user id (no authentication) in access.log file ? ignore - This record will be ignored. ip - Use ip address instead. (default) everybody - Use "everybody" instead. - use_comma Use comma instead point in reports. Eg.: use_comma yes => 23,450,110 use_comma no => 23.450.110 - mail_utility mail|mailx Which mail command must I use to send reports ? Added: now every squid code that contain the MISS word will be counted as out cache. Implementation requested by Eugeny Kuzakov Thank you for your help and for share your FreeBSD with me. Changed: the field url was changed to 8192 bytes to suport big urls. Thanks to Eugeny Kuzakov Changed: the header "TIME SPENT" changed to "USED TIME" in topuser report. Changed: no more nouser will be in reports but IP address instead. Changed: no more squid 1 log format supported. Bug fixed: wrong reports when using common log format (emulate_http on). Thanks to Patrick LIN Aug/06/1999: French language added by Fred Pacquier Thank you Bug fixed: negative percentage in IN-CACHE-OUT. Thanks to brad@baileylink.net Bug fixed: wrong directory name created when using -g e and -d Thanks to Fred Pacquier Changed: atol use to get total bytes changed to atoll. Thanks to brad@baileylink.net for the patch. Changed: now use ',' as separator instead '.' when using US date (-g u) Implementations requested by brad@baileylink.net Changed: added -convert and -split to usage help (-h) new messages added to easy translation. Implementations requested by Fred Pacquier Jul/29/1999: Changed: convert userid to lowercase to disable username case-sensitivity when using auth_smb. Implementations requested by Doug Burks Changed: the sqmgrlog.conf now installs into /usr/local/etc Implementations requested by Daniel L Sjvsvdrd Jul/06/1999: Y2K bug fixes. Thanks to askat@crimea.net (JSC CRELCOM) Bug fixed: special character in userid cause core dump. Thanks to Rick_Barzilli@xircom.com Splitlog function added: -split will split the log file by date in -d parameter. Eg.: sqmgrlog -split -d 01/07/1999-02/07/1999 [-convert] [-g e] Jun/14/1999: German language added by Andreas Piesk Thank you Some minor changes made by Andreas Piesk, thanks for the patches. Jun/09/1999: Bug fixed: to send reports via mail, use mail instead mailx in FreeBSD. Thanks to Evren Yurtesen to share your FreeBSD with me. Bug fixed: wrong userid when using smb_auth autenticator. The userid will be changed from NTDOMAIN\username to NTDOMAIN.username. Thanks to Jouko Ylikulju Jun/04/1999: Y2K compliance implemented. Bug fixed: wrong report created when using common log format. Thanks to Carlos Santillana Bug fixed: wrong fopen with "rt", must be "r". Thanks to Wayne Bastow May/31/1999: Turkish language added by Evren Yurtesen Thank you Bug fixed: users in exclude_users file were not removed from reports. Thanks to Arthur S. Petrossian Thanks to Evren Yurtesen Bug fixed: core dump when using output_email parm and mailx not installed. Thanks to Evren Yurtesen Thanks to Evren Yurtesen to share your FreeBSD with me. May/20/1999: New report field added: IN CACHE and OUT CACHE. This field show how many bytes (percent) was retrieved from the cache. Implementations requested by Arthur S. Petrossian May/14/1999: Bug fixed. Abnormal End when using -i option Thanks to Carlos Canau for the patch. Bug fixed. Sqmgrlog freeze if some records are broken in access.log file. Thanks to Rick_Barzilli@xircom.com Bugfix that prevents sqmgrlog from freezing up if a log file has "holes" (sequences of zeros) (caused by filesystem crash). Thanks to drdivano@mail.axon.ru for the patch. Apr/14/1999: Per user limit added. If the user exceed the limit, userid will be saved in a file that can be used in squid acl. Field per_user_limit added to sqmgrlog.conf: per_user_limit file limit file : where userid must be saved limit: in MB Eg. 40 will limit in 40 MB. Implementation requested by Csaba Kabai Mar/11/1999: Field exclude_users now accept indexonly to create only index.html report. Implementation requested by Hanni Daniel Bug fixed for FreeBSD. Missing \n on topuser. Thanks to Andrew for share your FreeBSD-3.1 Some minors fixes and changes in html layout. Thanks to Andrew Barnes Mar/03/1999: Bug fixed. Wrong href link if userid in format userid.name... Thanks to Manon Goo Some changes on variable translations. Thanks to Matteo Colombo Russian language (KOI8-R) added by Palamarchuk Eugen Thank you Field exclude_users added to sqmgrlog.conf. Users within the file will be excluded from reports. Implementation requested by Hanni Daniel Feb/26/1999: New date/time report added. Look at http://www.orso.x5.net/squid-reports/1999Feb01-1999Feb08/duser24.html -d option now accept from-until (dd/mm/yy-dd/mm/yy) dates. Requested by Eric V. Pino Feb/10/1999: Italian language added by Matteo Colombo Thank you. -convert option added. Convert the access.log file to a legible date and time format. May be used with -l and/or -g options. Feb/05/1999: Field date_format added to sqmgrlog.conf. date_format u: reports with USA format mm/dd/yy date_format e: reports with Europe format dd/mm/yy Implementation requested by Matteo Colombo Bug fixed: temporary file cannot be created if not run in root. Thanks to Carlos Canau for the patch. Changes from Tony Lorime : use atoll instead atol in Solaris : ignore .htaccess when selecting files Thank you. Dec/21/1998: -b option added. Generate useragent report. field useragent_log added to sqmgrlog.conf Implementation requested by Alp -j option added. Generate a kind of abuse report. Implementation requested by Alp To use this feature you must apply a patch (http://www.orso.x5.net/patches) on Squid. -c exclude option improved. Now you can exclude B classes Implementation requested by Yin Jun Bug fixed for Solaris. Must user -lsocket and -lnsl to resolve names. Thanks to Ryan Roehrich Dec/11/1998: Bug fixed for long long int in Alpha Digital Thanks to Ilya V. Komarov for share your Digital server. Dec/10/1998: Version 2.2 released -n option added. Resolve domain name for reports with IP Address. Field resolve_ip added to sqmgrlog.conf Sort report by header fields implemented Fields report1_sort_field and report2_sort_field added to sqmgrlog.conf -f option added. Allow config file override Exclude hosts implemented Field exclude_hosts file added to sqmgrlog.conf. Exclude ips, names, subnets from reports. Implementations requested by Arthur S. Petrossian Dec/07/1998: Version 2.1 released sqmgrlog now can read log file in gzip or compress format. Implementation requested by Alp Nov/09/1998: Version 2.0 released -p option added. Allow redirect output report to email address. sqmgrlog.conf with colors, headers, title, font size, backgound color, text color, background image, font face, etc... added. Reports will be generated only for users in passwd file (tag password in sqmgrlog.conf). Many changes in html output layout. Thanks to Alp Oct/19/1998: Bug fixed by Maxim Berlin for long long int in FreeBsd. Many thanks. Thanks to Ilya V. Komarov to share your FreeBSD 3.0 server to help on fixing. Sep/28/1998: Bug fixed for log with emulate http on (Squid 1.2.beta) Thanks to Alp -p option added. Generated reports with IP Address insted Userid. Use this option if you do not use Proxy authentication on Squid. Implementation requested by Szalma Zoltan Aug/11/1998: Bug fixed for memory slack. Thanks to kevin@mcpeake.net Jose Luiz Patrick Darden Steve Chan Jul/07/1998: Spent time added for native Squid log format (emulate_httpd_log off). Connect added. Layout change in html reports. Jun/02/1998: -o option added. Allow output dir override. Implemented index.html on root output dir. Implemented auto rename if output dir already exist. bug fixed, link error if user change output dir in conf.h Thanks to Alp May/28/1998: -v option added. Allow Squid version override. May/28/1998: Bug fixed in common log format Thanks to Tony Lorimer Alp Carlos Santillana Apr/15/1998: -z option added (debug) Apr/07/1998: top.html changed to index.html Mar/31/1998: index.html added Mar/25/1998: sqmgrlog was created