Tuesday, April 17, 2018

ISP data retention solutions

Hi /r/networking,

I am doing a project for selecting ISP data retention products. I am doing a study to decide a better fit. Could you recommend some relevant products?

Requirements: a. Collection of packet data at line speeds of at least 10Gbps (preferably covering the range 100-1000Gbps to accommodate expected traffic growth over next few years) b. Assembly of packets into flows (or other means to summarise individual packets) c. Inspection of packet data to characterise it d. Filtering to remove unwanted data e. Summarisation to reduce the amount of detail and hence storage volume and to make querying easier f. Enrichment to add other information from the packet flow and from external sources in order to increase the investigative value of the data g. Classification of traffic type to enable identification of internet service used (both fully qualified domain name and category/sub-category of service - for example "Facebook - social media - messaging" h. Querying facility to enable remote systems/users to rapidly search the stored data (ideally through a web service or external API) i. Query federation to enable a single query to be run on a number of systems distributed across the CSP network j. Persistent scalable storage for 3-12 months (ideally 12 months) k. Resilience to power interruption and equipment failure



No comments:

Post a Comment