dcsimg

How do I set up a data source in Webtrends Analytics Software?

Products

Webtrends Analytics 8.0x
Webtrends Analytics 8.1
Webtrends Analytics 8.5
Webtrends Analytics 8.7
Webtrends Analytics 9.2

Cause

Use the Data Sources dialog to manage and view information about the data sources for your profiles. Data sources store information about where Webtrends should access your site data.

You must have a configured data source to create a profile. You can also use this dialog to create data sources and to get JavaScript tracking code for an existing data source. JavaScript tracking code is used to collect data.

If you only use SDC data sources, this dialog shows the Managed SDC Account Rollup data source in addition to the SDC data sources you have configured. The Managed SDC Account Rollup data source combines all the data in your SDC data sources. If you report on multiple data sources, you can select this data source to report on all your data in a single report. The Managed SDC Account Rollup data source does not exist unless you have defined one or more SDC data sources, and you have not defined any non-SDC data sources. If you create a non-SDC data source after assigning the Managed SDC Account Rollup data source to a profile, any profiles that use the Rollup data source will stop working.

Resolution

You can use this dialog for the following tasks:

1. To create a new data source, click New.
2. To find a data source by name, type all or part of the data source name in the Search text box and click Search.
3. To open the Tag Builder and create tracking code for an SDC data source, click Build Tag (Tracking Code).
4. To edit a data source or view its settings, mouse over the data source and click Edit on the Action menu.
5. To create a new source based on an existing one, mouse over it and click Copy on the Action menu.
6. To view a list of profiles that use a data source, mouse over it and click Show Uses on the Action menu.
7. To see a list of changes to data sources, click View Change History.
8. To delete a data source, mouse over the data source and click Delete on the Action menu. If a profile is currently assigned to a data source, Delete is not available.

Field Descriptions:
Name – Specifies the name of the data source.
Content – Specifies whether the source of your site data is a web server log file, a streaming media server log file, or a SmartSource Data Collector (SDC) file, and whether it is a Managed SDC Account Rollup.
Format – Specifies the expected data format for this data source.

To access the Data Sources feature, in the left pane click Administration > Application Settings > Data Sources

Data Source Type
Use the Data Source Type option to specify the type of content and source type for this data source.

Field Descriptions
Web: Log File – Uses web server log file data as the source for your analysis.
Web: SmartSource Data Files – Uses SmartSource data as the source for your analysis. If you use SmartSource Data Collector to collect your site data, select this option.

NOTE: In all circumstances Web: Log file can be selected regardless of the type of log you are analyzing.

Log File Path Examples
To report on your web site activity, you need to specify the location of your web activity data in the Data Sources dialog. You can separate multiple log file names using the pipe character (|) or use wildcards to specify multiple log files. You can also use date macros to specify log files with file names that indicate the date the log file was created. To avoid problems with user rights, store your log files in a network location, specify their location using a UNC path, and make sure that all Webtrends computers have rights to that location .

Note: If you specify a UNC path, make sure the Webtrends Scheduler agent on each analysis computer in your installation is configured to log on as an account with access rights to the computers where your data sources reside.

UNC path to a single log file:
\\webserver\logfiles\ex990111.log

UNC path to multiple log files:
To prevent unintended analysis of partial data it is best to use two separate data sources
(Note: Both data sources must have valid logs for analysis to proceed).

Data source # 1 = \\webserver\logfiles\ex990111.log
Data source # 2 = c:\logfiles\ex990112.log

UNC path to compressed log files:
\\machine1\logs\ex980224.zip

UNC path to multiple logs, using wildcards:
\\mainserver\logfiles\ex*.log

FTP path to a single log file, specifying port:
ftp://10.0.0.0:99/ex990729.log, where 10.0.0.0 is the IP address of the FTP server and 99 is the port.

FTP path to multiple log files:
To prevent unintended analysis of partial data it is best to use two seperate data sources

Data source # 1 ftp://www.domain.com/logfiles/ex990701.log
Data source # 2 ftp://www.domain.com /logfiles/ex990730.log

Note: Both data sources must have valid logs for analysis to proceed.

Path to a single log file:
c:\logfiles\ex980224.log

Log File Path Date Macros:
To express relative dates and times, plus (+) and minus (-) modifiers are used within the square brackets of the date macros. For example, “[DD-2]” represents two days ago. Date and time macro modifiers affect the entire macro expression. The following examples illustrate this behavior:
If today is September 14, 2008. “[YYYY]-[MM]-[DD-3]” will be interpreted as “2008-09-11”
If today is October 15, 2008. “[YYYY]-[MM-1]-01” will be interpreted as “2008-09-01”
– If today is November 16, 2008. “[YYYY+5]-[MM+3]-[DD]” will be interpreted as “2014-02-16”
– If today is January 1, 2008. “[YYYY]-[MM]-[DD-1]” will be interpreted as “2007-12-31”

Schedule and Date Macro Tips:
To get an end-of-month report, schedule a report to run on “1” (first day of month), set the Start Date to “[YYYY]-[MM-1]-01” and set the End Date to “[YYYY]-[MM]-[DD-1]”
To get an end-of-week (ending on Saturday) report, schedule a report to run on “Sunday”, set the Start Date to “[YYYY]-[MM]-[DD-7]” and set the End Date to “[YYYY]-[MM]-[DD-1]”
To get “daily” reports that cover yesterday’s activity, schedule a report to run on “All”, set the Start Date to “[YYYY]-[MM]-[DD-1]” and set the End Date to “[YYYY]-[MM]-[DD-1]”

Using WebTrends Analytics software, you can use the following macros to specify log file paths that retrieve files for specific dates:
%date-n% – Subtracts n days from current date. For example, if today is February 4, 2008 the macro %date-5%%mm%%dd%%yyyy% produces 01302008. This macro must precede any other macros.
%date+n% – Adds n days to current date. For example, if today is February 4, 2008, the macro %date+5%%mm%%dd%%yyyy% produces 02092008. This macro must precede any other macros.
%dd% – Replaces macro with current day of the month. Value is expressed as a number, for example 02.
%dd-n% – Subtracts n days from the current day of the month and replaces the macro with a value expressed as a number. For example, if the current day is the 20th of the month, the macro %dd-8% produces a value of 12.
%dd+n% – Adds n days to the current day of the month and replaces the macro with a value expressed as a number. For example, if the current day is 10th of the month, the macro %dd+7% produces a value of 17.
%dw% – Replaces macro with current day of week. Value is expressed as a number within the range of 0 – 6, with Sunday being 0 and Saturday being 6.
%dy% – Replaces macro with current day of year. Value is expressed as a number with range of 1 – 366.
%hour% – Replaces macro with current hour.
%minute% – Replaces macro with current minute.
%mm% – Replaces macro with current month. Value is expressed as a number, for example 01.
%mm-n% – Subtracts n months from the current month and replaces the macro with a value expressed as a number. For example, if the current month is May (05), the macro %mm-3% produces 02 (February).
%mm+n% – Adds n months to the current month and replaces the macro with a value expressed as a number. For example, if the current month is May (05), the macro %mm+3% produces 08 (August).
%Mon% – Replaces macro with current month. The first letter of the month is capitalized and the value is expressed as string, for example Jan.
%mon% – Replaces macro with current month. The month is in all lower case and the value is expressed as a string, for example jan.
%MON% – Replaces macro with current month. The month is in all upper case and the value is expressed as string, for example, JAN.
%month% – Same as %mm% (see above).
%second% – Replaces macro with current second.
%wm% – Replaces macro with current week of the month. Value is expressed as a number with range of 0 – 5, for example, 4. This value is not affected by date- or date+ macros.
%wy% – Replaces macro with current week of year. Value is expressed as a number with range of 0 – 53.
%yday% – Replaces macro with date of yesterday. Value is expressed as a number, for example 25. This value is not affected by date- or date+ macros.
%ymonth% – Replaces macro with yesterday?s month. Value is expressed as a number with range of 1 – 12, for example 6. Is not affected by date- or date+ macros.
%yy% – Replaces macro with current year. Value is expressed as a two-digit number, for example, 02.
%yy-n% – Subtracts n days from the current year and replaces the macro with a value expressed as a two-digit number. For example, if the current year is 2008, the macro %yy-1% produces a value of 07.
%yy+n% – Adds n days to the current year and replaces the macro with a value expressed as a two-digit number. For example, if the current year is 2008, the macro %yy+4% produces a value of 12.
%yyear% – Replaces macro with yesterday?s year. Value is expressed as two digit number, for example 01. Is not affected by date- or date+ macros.
%yyyy% – Replaces macro with current year. Value is expressed as a four digit number, for example 2008.
%yyyy-n% – Subtracts n years from the current year and replaces the macro with a value expressed as a four-digit number. For example, if the current year is 2008, the macro %yyyy-1% produces a value of 2007.
%yyyy+n% – Adds n years to the current year and replaces the macro with a value that?s expressed as a four-digit number. For example, if the current year is 2008, the macro %yyyy+4% produces a value of 2012.