Motivation of Research
- Handling Data Streams as Binaries
- Reading flat files into memory as a single binary
- Receiving large data streams over the network
- Middleman transformers in high volume applications
- Routing or multiplexing a stream of data
- Memory Limitations
- Downcasing binary ran out of memory between 5M and 50M bytes
- Bit syntax extracting from 500K binary crashed with HiPE
- Decided to try writing BIFs for very large binaries