Log file information

A log file looks like(head 3 rows):

Columns information (for example):


Question1 Find out where the log files came from?

Anwser:

Question2 UUID - add authorisation token / member id to the logs

Example: ios users logged in successed times in one day:

It is impossible for a user loged our app more then 1,000 times/day.


Request: Create a real-time dashbord

  1. Data flow problem

(should check) Option 1: Data accessed from S3 bucket on a daily/weekly basis and uploaded to Google bigquery (O) Option 2: Data accessed from the in-house database directly by the reporting system/dashboards

  1. Now we can do?

Should do list

  1. Evens definition:

sample log data visualization

  1. different s-ips
  1. different actions