The three basic steps of using SpectX are selecting your data source, describing or choosing the pattern and writing a query. SpectX runs extremely fast even on billions of records.
All it needs to know is your data location and the pattern for parsing it.
Here's how to quickly look at all 404-records returned by a web server. To get more insight, you can quickly spot which URIs are the top 'troublemakers', calculate country codes and ASN-names from IP-addresses.
Listing millions of blobs or files in the cloud can get inefficient. SpectX offers flexible query optimization that allows selecting from only those files that are relevant to a particular query. In addition to the name and exact path, listing reveals metadata such as last modified time, file size, etc.
Log rotation can cause some of the records from today to be logged into the files of yesterday or the files of tomorrow. Applying filters in SpectX can still give us an exact match for records of a certain period. No matter the timestamp in their file uri.
SpectX is a flexible tool for playing around with your data, digging deeper into suspicious patterns and finding anomalies.