pingpong.git
5 years agoRemoving SmartPlugDetector.
rtrimana [Tue, 5 Feb 2019 01:39:30 +0000 (17:39 -0800)]
Removing SmartPlugDetector.

5 years agoRenaming root project name.
rtrimana [Tue, 5 Feb 2019 01:37:09 +0000 (17:37 -0800)]
Renaming root project name.

5 years agoStop echoing commands to std out
Janus Varmarken [Sat, 26 Jan 2019 00:47:19 +0000 (16:47 -0800)]
Stop echoing commands to std out

5 years agoadd script for executing layer 2 detection on UNSW traces
Janus Varmarken [Sat, 26 Jan 2019 00:39:19 +0000 (16:39 -0800)]
add script for executing layer 2 detection on UNSW traces

5 years agoAdding time constraints into the scripts.
rtrimana [Fri, 25 Jan 2019 23:01:25 +0000 (15:01 -0800)]
Adding time constraints into the scripts.

5 years agoAdded time constraintsto detection.
rtrimana [Fri, 25 Jan 2019 22:19:49 +0000 (14:19 -0800)]
Added time constraintsto detection.

5 years agoMerge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic
rtrimana [Wed, 23 Jan 2019 22:15:50 +0000 (14:15 -0800)]
Merge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic

5 years agoAdding new experiments for sensitivity analysis.
rtrimana [Wed, 23 Jan 2019 22:15:34 +0000 (14:15 -0800)]
Adding new experiments for sensitivity analysis.

5 years agoexecute_layer2_unb_all_detection.sh: fix typo in declaration of PCAP_FILE variable
Janus Varmarken [Wed, 23 Jan 2019 19:04:11 +0000 (11:04 -0800)]
execute_layer2_unb_all_detection.sh: fix typo in declaration of PCAP_FILE variable

5 years agoAdd script for running layer 2 detection on UNB trace for all devices.
Janus Varmarken [Wed, 23 Jan 2019 18:14:57 +0000 (10:14 -0800)]
Add script for running layer 2 detection on UNB trace for all devices.

5 years agoadd MAC filters to detection script for tplink bulb and plug
Janus Varmarken [Wed, 23 Jan 2019 07:34:55 +0000 (23:34 -0800)]
add MAC filters to detection script for tplink bulb and plug

5 years agoAdd capability to filter flows when performing layer 2 detection
Janus Varmarken [Wed, 23 Jan 2019 06:48:40 +0000 (22:48 -0800)]
Add capability to filter flows when performing layer 2 detection

5 years agoBUGFIX: Make sure to always spawn a new sequence matcher when a sequence matcher...
Janus Varmarken [Mon, 21 Jan 2019 23:51:03 +0000 (15:51 -0800)]
BUGFIX: Make sure to always spawn a new sequence matcher when a sequence matcher terminates, ALSO in the case of 1-packet sequences

5 years agoFix typo in output from Layer2SignatureDetector
Janus Varmarken [Mon, 21 Jan 2019 23:29:34 +0000 (15:29 -0800)]
Fix typo in output from Layer2SignatureDetector

5 years agoRemove dlink-siren device side from layer 2 detection and layer 2 detection analysis...
Janus Varmarken [Mon, 21 Jan 2019 21:57:23 +0000 (13:57 -0800)]
Remove dlink-siren device side from layer 2 detection and layer 2 detection analysis scripts as it does not have a device side signature. D-link siren device side signature files in experimental_results are legacy files that should not be considered.

5 years agoLayer 2 detection script: fix mistake in output path for Wemo Plug.
Janus Varmarken [Mon, 21 Jan 2019 19:44:50 +0000 (11:44 -0800)]
Layer 2 detection script: fix mistake in output path for Wemo Plug.

5 years agoUpdate layer 2 detection script to refer correct main class.
Janus Varmarken [Mon, 21 Jan 2019 19:29:46 +0000 (11:29 -0800)]
Update layer 2 detection script to refer correct main class.

5 years agoAdd remaining 10 devices with signatures to layer 2 detection results analysis script.
Janus Varmarken [Mon, 21 Jan 2019 19:09:45 +0000 (11:09 -0800)]
Add remaining 10 devices with signatures to layer 2 detection results analysis script.

5 years agoAdd script that analyzes results of smarthome detection experiments for 2 devices...
Janus Varmarken [Sat, 19 Jan 2019 09:16:47 +0000 (01:16 -0800)]
Add script that analyzes results of smarthome detection experiments for 2 devices. Still need to add remaining devices to this script.

5 years agoUpdate DetectionResultsAnalyzer to also print results to a file. Convert Layer2Signat...
Janus Varmarken [Sat, 19 Jan 2019 09:15:37 +0000 (01:15 -0800)]
Update DetectionResultsAnalyzer to also print results to a file. Convert Layer2SignatureDetector to reuse PrintWriterUtils instead of specifying its own code for the same purpose.

5 years agoAdd utility for printing to a file and to std out simultaneously
Janus Varmarken [Sat, 19 Jan 2019 09:13:14 +0000 (01:13 -0800)]
Add utility for printing to a file and to std out simultaneously

5 years agoTo enable easy changes to the application main entry point when executed using gradle...
Janus Varmarken [Sat, 19 Jan 2019 09:02:14 +0000 (01:02 -0800)]
To enable easy changes to the application main entry point when executed using gradle run, main class must now be provided as a system property when using the gradle run task. Sample use: gradlew run -DmainClass=edu.uci.iotproject.evaluation.DetectionResultsAnalyzer --args="arg1 arg2"

5 years agoRename script that performs detection on all smarthome traces.
Janus Varmarken [Sat, 19 Jan 2019 08:58:52 +0000 (00:58 -0800)]
Rename script that performs detection on all smarthome traces.

5 years agoAdd script that executes layer2 detection on all smarthome traces (traces where one...
Janus Varmarken [Sat, 19 Jan 2019 05:16:53 +0000 (21:16 -0800)]
Add script that executes layer2 detection on all smarthome traces (traces where one device is active, and the remaining devices are powered on, but idle)

5 years agoMerge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic
rtrimana [Sat, 19 Jan 2019 01:57:59 +0000 (17:57 -0800)]
Merge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic

5 years agoAdding sensitivity experiment.
rtrimana [Sat, 19 Jan 2019 01:57:36 +0000 (17:57 -0800)]
Adding sensitivity experiment.

5 years agoUpdate Layer2 detection to only allow one sequence matcher in each state for each...
Janus Varmarken [Fri, 18 Jan 2019 09:15:36 +0000 (01:15 -0800)]
Update Layer2 detection to only allow one sequence matcher in each state for each flow.

5 years agoBacking up first working version of layer 2 signature detection. Lacks functionality...
Janus Varmarken [Fri, 18 Jan 2019 06:17:59 +0000 (22:17 -0800)]
Backing up first working version of layer 2 signature detection. Lacks functionality that prevents having multiple signature matchers in the same state and/or filtering. Also needs cleanup.

5 years agoMerge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic
rtrimana [Thu, 17 Jan 2019 18:11:34 +0000 (10:11 -0800)]
Merge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic

5 years agoChecking in the latest experiments.
rtrimana [Thu, 17 Jan 2019 18:11:17 +0000 (10:11 -0800)]
Checking in the latest experiments.

5 years agoAdd utility for analyzing the success of a detection run
Janus Varmarken [Thu, 17 Jan 2019 00:21:38 +0000 (16:21 -0800)]
Add utility for analyzing the success of a detection run

5 years agoMerge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic
rtrimana [Tue, 15 Jan 2019 19:31:52 +0000 (11:31 -0800)]
Merge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic

5 years agoAdding features to process Blossom sprinkler's data: removing overlapping sequences.
rtrimana [Tue, 15 Jan 2019 19:31:18 +0000 (11:31 -0800)]
Adding features to process Blossom sprinkler's data: removing overlapping sequences.

5 years agoExtract ClusterMatcherObserver interface to separate file and move code that handles...
Janus Varmarken [Mon, 14 Jan 2019 23:54:36 +0000 (15:54 -0800)]
Extract ClusterMatcherObserver interface to separate file and move code that handles observer (de-)registration to AbstractClusterMatcher.

5 years agoMerge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic
rtrimana [Mon, 14 Jan 2019 18:03:15 +0000 (10:03 -0800)]
Merge branch 'master' of https://github.uci.edu/rtrimana/smart_home_traffic

5 years agoMerging small changes.
rtrimana [Mon, 14 Jan 2019 18:02:44 +0000 (10:02 -0800)]
Merging small changes.

5 years agoLayer2SequenceMatcher: check packet directions when matching sequence.
Janus Varmarken [Sun, 13 Jan 2019 22:16:44 +0000 (14:16 -0800)]
Layer2SequenceMatcher: check packet directions when matching sequence.

5 years agoMake original ClusterMatcher inherit from AbstractClusterMatcher. Reorganize code...
Janus Varmarken [Sun, 13 Jan 2019 05:03:30 +0000 (21:03 -0800)]
Make original ClusterMatcher inherit from AbstractClusterMatcher. Reorganize code by adding subpackages for layer2 and layer3 detection.

5 years agoReorganize code by creating a package for code that reassembles traffic flows at...
Janus Varmarken [Sun, 13 Jan 2019 04:18:53 +0000 (20:18 -0800)]
Reorganize code by creating a package for code that reassembles traffic flows at different layers

5 years agoCleanup of layer 2 sequence detection: get rid of some experimental classes
Janus Varmarken [Sun, 13 Jan 2019 04:05:29 +0000 (20:05 -0800)]
Cleanup of layer 2 sequence detection: get rid of some experimental classes

5 years agoFirst work on layer 2 sequence matching. Basic functionality seems to work. Cleanup...
Janus Varmarken [Sun, 13 Jan 2019 03:58:13 +0000 (19:58 -0800)]
First work on layer 2 sequence matching. Basic functionality seems to work. Cleanup needed.

5 years agoChecking in new files and new entries for Blossom sprinkler.
rtrimana [Fri, 11 Jan 2019 02:08:04 +0000 (18:08 -0800)]
Checking in new files and new entries for Blossom sprinkler.

5 years agoClearing up conflicts.
rtrimana [Wed, 28 Nov 2018 16:16:57 +0000 (08:16 -0800)]
Clearing up conflicts.

5 years agoMerging changes.
rtrimana [Wed, 28 Nov 2018 16:14:54 +0000 (08:14 -0800)]
Merging changes.

5 years agoSignatureDetector: get filenames from program arguments in order to make execution...
Janus Varmarken [Wed, 28 Nov 2018 15:53:02 +0000 (07:53 -0800)]
SignatureDetector: get filenames from program arguments in order to make execution on Zeus simpler (avoid push + pull whenever we explore a new signature on a new file)

5 years agoadded a hacky solution for extracting a sanity-check signature to be run against...
Janus Varmarken [Wed, 28 Nov 2018 07:05:25 +0000 (23:05 -0800)]
added a hacky solution for extracting a sanity-check signature to be run against negative test sets

5 years agoIMPORTANT BUGFIX: consider FULL range of local IPs when determining clietnIsSrc in...
Janus Varmarken [Wed, 28 Nov 2018 06:57:26 +0000 (22:57 -0800)]
IMPORTANT BUGFIX: consider FULL range of local IPs when determining clietnIsSrc in TcpReassembler

5 years agoPoint Zeus to ST plug signatures
Janus Varmarken [Wed, 28 Nov 2018 04:49:24 +0000 (20:49 -0800)]
Point Zeus to ST plug signatures

5 years agoAdd output that displays what files are in use; point Zeus to kwikset signatures.
Janus Varmarken [Wed, 28 Nov 2018 04:11:50 +0000 (20:11 -0800)]
Add output that displays what files are in use; point Zeus to kwikset signatures.

5 years agoPrepare code for execution on Zeus (including upping mem limit to 300gigs)
Janus Varmarken [Wed, 28 Nov 2018 03:14:22 +0000 (19:14 -0800)]
Prepare code for execution on Zeus (including upping mem limit to 300gigs)

5 years agoRevert back to full MondayWorkhours file; increase Xmx to 64GB as default when run...
Janus Varmarken [Wed, 28 Nov 2018 01:16:10 +0000 (17:16 -0800)]
Revert back to full MondayWorkhours file; increase Xmx to 64GB as default when run using gradle run

5 years agoPrepare code for execution on Hera (networking group server)
Janus Varmarken [Tue, 27 Nov 2018 21:35:17 +0000 (13:35 -0800)]
Prepare code for execution on Hera (networking group server)

5 years agoAdding WeMo Inisght paths for experimental setup.
rtrimana [Fri, 23 Nov 2018 19:58:26 +0000 (11:58 -0800)]
Adding WeMo Inisght paths for experimental setup.

5 years agoAdding WeMo plugs' paths for experimental results.
rtrimana [Thu, 22 Nov 2018 16:17:54 +0000 (08:17 -0800)]
Adding WeMo plugs' paths for experimental results.

5 years agoAdding new smart home devices into the experiment.
rtrimana [Wed, 21 Nov 2018 21:13:49 +0000 (13:13 -0800)]
Adding new smart home devices into the experiment.

5 years agoAdding new devices under test.
rtrimana [Sat, 17 Nov 2018 01:09:53 +0000 (17:09 -0800)]
Adding new devices under test.

5 years agoAdding more devices into the experimental setup.
rtrimana [Tue, 13 Nov 2018 23:38:25 +0000 (15:38 -0800)]
Adding more devices into the experimental setup.

5 years agoAdding more execution parameters for experimental results (evaluation).
rtrimana [Sun, 11 Nov 2018 03:45:24 +0000 (19:45 -0800)]
Adding more execution parameters for experimental results (evaluation).

5 years agoprune clusters in order to allow detection of different pairs in same connection
Janus Varmarken [Thu, 8 Nov 2018 18:34:52 +0000 (10:34 -0800)]
prune clusters in order to allow detection of different pairs in same connection

5 years agoAdding a method to delete a bad sequence in a signature after we test the produced...
rtrimana [Wed, 7 Nov 2018 19:03:20 +0000 (11:03 -0800)]
Adding a method to delete a bad sequence in a signature after we test the produced signature file against its own PCAP file---one case like this is the Nest Thermostat.

5 years agoFixing curl for twitter.com in browser.sh.
rtrimana [Wed, 7 Nov 2018 00:52:31 +0000 (16:52 -0800)]
Fixing curl for twitter.com in browser.sh.

5 years agoAdding more websites to the fake browser.
rtrimana [Wed, 7 Nov 2018 00:49:12 +0000 (16:49 -0800)]
Adding more websites to the fake browser.

5 years agoAdding a dummy browser script.
rtrimana [Mon, 5 Nov 2018 19:35:13 +0000 (11:35 -0800)]
Adding a dummy browser script.

5 years agoTemporary fix for router's IP as client for WAN trace and paths for new tests for...
rtrimana [Fri, 2 Nov 2018 23:05:14 +0000 (16:05 -0700)]
Temporary fix for router's IP as client for WAN trace and paths for new tests for devices.

5 years agoMaking sure that merging would fail if there is a situation where two sequences are...
rtrimana [Wed, 31 Oct 2018 23:28:21 +0000 (16:28 -0700)]
Making sure that merging would fail if there is a situation where two sequences are sometimes adjacent and sometimes aren't. The detection part will detect these, instead, as separate ordered sequences (that are in one TCP connection).

5 years agoChecking in new code for signature generation; Arlo has a signature for camera on...
rtrimana [Wed, 31 Oct 2018 16:56:59 +0000 (09:56 -0700)]
Checking in new code for signature generation; Arlo has a signature for camera on/off! :)

5 years agoAdding a temporary cleanup for duplicate timestamps due to ON and OFF signatures...
rtrimana [Thu, 18 Oct 2018 22:07:06 +0000 (15:07 -0700)]
Adding a temporary cleanup for duplicate timestamps due to ON and OFF signatures having the same sequences (and thus the same event is detected and printed twice).

5 years agoAdding array out of bound check for timestamps comparison.
rtrimana [Thu, 18 Oct 2018 20:20:30 +0000 (13:20 -0700)]
Adding array out of bound check for timestamps comparison.

5 years agoTesting the flow starting from D-Link plug for training and signature generation.
rtrimana [Thu, 18 Oct 2018 20:19:38 +0000 (13:19 -0700)]
Testing the flow starting from D-Link plug for training and signature generation.

5 years agoAdding files for training for paper evaluation.
rtrimana [Wed, 17 Oct 2018 23:45:32 +0000 (16:45 -0700)]
Adding files for training for paper evaluation.

5 years agoAdding PCAP file for no-activity.
rtrimana [Thu, 11 Oct 2018 00:01:19 +0000 (17:01 -0700)]
Adding PCAP file for no-activity.

5 years agoAdding a script to compare 2 timestamps files to validate the detection process.
rtrimana [Tue, 9 Oct 2018 23:39:42 +0000 (16:39 -0700)]
Adding a script to compare 2 timestamps files to validate the detection process.

5 years agoSignatureDetector: add paths to dlink plug evaluation experiment
Janus Varmarken [Tue, 9 Oct 2018 17:32:12 +0000 (10:32 -0700)]
SignatureDetector: add paths to dlink plug evaluation experiment

5 years agoTcpReassembler: skip non-IPv4 traffic; SignatureDetector: add paths to d-link evaluat...
Janus Varmarken [Tue, 9 Oct 2018 17:31:13 +0000 (10:31 -0700)]
TcpReassembler: skip non-IPv4 traffic; SignatureDetector: add paths to d-link evaluation experiment

5 years agoFixing conflict for SignatureDetector.java.
rtrimana [Tue, 9 Oct 2018 00:42:33 +0000 (17:42 -0700)]
Fixing conflict for SignatureDetector.java.

5 years agoCommitting local changes.
rtrimana [Tue, 9 Oct 2018 00:03:51 +0000 (17:03 -0700)]
Committing local changes.

5 years agoadd filepaths for dlink siren and dlink plug to SignatureDetector's embedded test...
Janus Varmarken [Wed, 3 Oct 2018 22:17:13 +0000 (15:17 -0700)]
add filepaths for dlink siren and dlink plug to SignatureDetector's embedded test client

5 years agoSignatureDetector.java cleanup: remove initial attempts at algorithm; add some javadoc.
Janus Varmarken [Tue, 2 Oct 2018 23:39:21 +0000 (16:39 -0700)]
SignatureDetector.java cleanup: remove initial attempts at algorithm; add some javadoc.

5 years agoAdded SignatureDetector which can detect signatures spanning multiple TCP connections
Janus Varmarken [Tue, 2 Oct 2018 23:32:27 +0000 (16:32 -0700)]
Added SignatureDetector which can detect signatures spanning multiple TCP connections

5 years agoClusterMatcher.java: cleanup; add javadoc; change signature of observer interface
Janus Varmarken [Wed, 26 Sep 2018 22:47:51 +0000 (15:47 -0700)]
ClusterMatcher.java: cleanup; add javadoc; change signature of observer interface

5 years agorename SignatureDetector to ClusterMatcher
Janus Varmarken [Wed, 26 Sep 2018 19:54:32 +0000 (12:54 -0700)]
rename SignatureDetector to ClusterMatcher

5 years agoAdding the serializer/deserializer for the entire signature.
rtrimana [Wed, 26 Sep 2018 18:58:03 +0000 (11:58 -0700)]
Adding the serializer/deserializer for the entire signature.

5 years agoSignatureDetector.java: now also detects when the same sequence occurs multiple times...
Janus Varmarken [Wed, 26 Sep 2018 01:28:22 +0000 (18:28 -0700)]
SignatureDetector.java: now also detects when the same sequence occurs multiple times in the same conversation.

5 years agobacking up first "working" version of SignatureDetector; note that this version does...
Janus Varmarken [Tue, 25 Sep 2018 23:49:34 +0000 (16:49 -0700)]
backing up first "working" version of SignatureDetector; note that this version does not manage to capture those cases where the signature appears multiple times in the same TCP Conversation.

5 years agoSignatureDetector.java: closer towards final implementation (e.g., also check packet...
Janus Varmarken [Sat, 22 Sep 2018 00:29:59 +0000 (17:29 -0700)]
SignatureDetector.java: closer towards final implementation (e.g., also check packet direction when detecting signatures)

5 years agoPcapPacketUtils.java: change implementation of getSourceIp(PcapPacket) to throw a...
Janus Varmarken [Fri, 21 Sep 2018 23:00:48 +0000 (16:00 -0700)]
PcapPacketUtils.java: change implementation of getSourceIp(PcapPacket) to throw a NullPointerException instead of returning null if the provided packet does not contain an IpV4Packet; add implementations of getDestinationIp(PcapPacket), isSrcIpLocal(PcapPacket), isDstIpLocal(PcapPacket), getIpV4PacketOrThrow(PcapPacket).

5 years agoAdding signature sorting by timestamps.
rtrimana [Sat, 22 Sep 2018 00:00:12 +0000 (17:00 -0700)]
Adding signature sorting by timestamps.

5 years agoPerformance bug found---unnecessary outer loop introduced.
rtrimana [Fri, 21 Sep 2018 21:01:12 +0000 (14:01 -0700)]
Performance bug found---unnecessary outer loop introduced.

5 years ago[minor work in progress]
Janus Varmarken [Fri, 21 Sep 2018 17:56:27 +0000 (10:56 -0700)]
[minor work in progress]

5 years agopreliminary work on signature detection
Janus Varmarken [Thu, 20 Sep 2018 23:45:39 +0000 (16:45 -0700)]
preliminary work on signature detection

5 years agoAdding signature combining; we can improve the performance later by requiring that...
rtrimana [Thu, 20 Sep 2018 23:29:08 +0000 (16:29 -0700)]
Adding signature combining; we can improve the performance later by requiring that the Conversation list should always be sorted based on timestamps.

5 years agoSupport for starting a live capture.
Janus Varmarken [Wed, 19 Sep 2018 22:11:10 +0000 (15:11 -0700)]
Support for starting a live capture.
Support for terminating PcapHandleReader.

5 years agoOnly taking signatures in the range of trigger+/-5; pad with null if the second eleme...
rtrimana [Wed, 19 Sep 2018 18:12:04 +0000 (11:12 -0700)]
Only taking signatures in the range of trigger+/-5; pad with null if the second element of the pair is null.

5 years agoAdding the basic signature harvesting (i.e., also saving to and reading back from...
rtrimana [Wed, 19 Sep 2018 16:54:30 +0000 (09:54 -0700)]
Adding the basic signature harvesting (i.e., also saving to and reading back from signature files).

5 years agoResolving conflict.
rtrimana [Mon, 17 Sep 2018 23:30:54 +0000 (16:30 -0700)]
Resolving conflict.

5 years agoAdding noise diff code.
rtrimana [Mon, 17 Sep 2018 23:27:23 +0000 (16:27 -0700)]
Adding noise diff code.

5 years agoFinished java-based clustering implementation (note: had to move Clusterable implemen...
Janus Varmarken [Mon, 17 Sep 2018 22:39:40 +0000 (15:39 -0700)]
Finished java-based clustering implementation (note: had to move Clusterable implementation to PcapPacketPair and get rid of PcapPacketPairWrapper).

5 years agoPcapPacketPairWrapper: add boolean value for toggling between simplistic and sophisti...
Janus Varmarken [Mon, 17 Sep 2018 20:45:12 +0000 (13:45 -0700)]
PcapPacketPairWrapper: add boolean value for toggling between simplistic and sophisticated source matching

5 years agochanges to .iml file that didn't make it into last commit (rebase action)
Janus Varmarken [Mon, 17 Sep 2018 18:18:58 +0000 (11:18 -0700)]
changes to .iml file that didn't make it into last commit (rebase action)

5 years agoAdd Apache Commons Math as dependency and implement first version of PcapPacketPairWr...
Janus Varmarken [Mon, 17 Sep 2018 18:00:41 +0000 (11:00 -0700)]
Add Apache Commons Math as dependency and implement first version of PcapPacketPairWrapper to allow for clustering in Java