Network Pipeline Internal Modules

network_pipeline.build_packet_key.build_packet_key()

network_pipeline.connect_forwarder.connect_forwarder(forward_host=None, forward_port=None, max_retries=-1, sleep_interval=1.0)

Parameters:

• forward_host – host for receiving forwarded packets
• forward_port – port for the forwarded packets
• max_retries – retries, -1 = infinite
• sleep_interval – how often to retry in this loop

network_pipeline.convert_pkt_to_json.convert_pkt_to_json(pkg)

Inspired by: https://gist.githubusercontent.com/cr0hn/1b0c2e672cd0721d3a07/raw/9144676ceb12dbd545e6dce366822bbedde8de2c/pkg_to_json.py This function convert a Scapy packet to JSON

Parameters:pkg (objects) – A kamene package Returns:A JSON data Return type:dict()

network_pipeline.create_layer_2_socket.create_layer_2_socket()

network_pipeline.parse_network_data.eth_addr(f)

Parameters:f – eth frame

network_pipeline.parse_network_data.unshift_flags(tcp_flags)

De-shift the TCP flags to a string repr

network_pipeline.parse_network_data.build_key()

network_pipeline.parse_network_data.parse_network_data(data_packet=None, include_filter_key=None, filter_keys=[], record_tcp=True, record_udp=True, record_arp=True, record_icmp=True)

build_node

Parameters:

• data_packet – raw recvfrom data
• filter_keys – list of strings to filter and remove baby-birding packets to yourself
• record_tcp – want to record TCP frames?
• record_udp – want to record UDP frames?
• record_arp – want to record ARP frames?
• record_icmp – want to record ICMP frames?

network_pipeline.publisher.get_publisher()

network_pipeline.utils.rnow(f='%Y-%m-%d %H:%M:%S')

Parameters:f – format for the string

network_pipeline.utils.ppj(json_data)

Parameters:json_data – dictionary to print

network_pipeline.start_consumers_for_queue.start_consumers_for_queue(prefix_name='worker', num_workers=2, tasks=None, queue_to_consume=None, shutdown_msg='SHUTDOWN', consumer_class=None, need_response=False, callback=None)

Parameters:

• prefix_name –
• num_workers –
• tasks –
• queue_to_consume –
• shutdown_msg –
• consumer_class –
• need_response –
• callback –

class network_pipeline.network_packet_task.NetworkPacketTask(source='locahost', payload=None)

network_pipeline.shutdown_consumers.shutdown_consumers(num_workers=2, tasks=None, shutdown_msg='SHUTDOWN')

Parameters:

• num_workers –
• tasks –
• shutdown_msg –

class network_pipeline.simulated_work_task.SimulatedWorkTask(a, b)

class network_pipeline.worker_to_process_packets.WorkerToProcessPackets(name, task_queue, result_queue, shutdown_msg='SHUTDOWN', need_response=False, callback=None)

run()