An exploration of dynamic Markov compression

dc.contributor.authorWhitehead, Robert Fletcheren
dc.date.accessioned2014-08-31T19:56:07Z
dc.date.available2014-08-31T19:56:07Z
dc.date.issued1994en
dc.description.abstractData Compression is the process of removing redundancy from data. Dynamic Markov Compression (DMC), developed by Cormack and Horspool, is a method for performing statistical data compression of a binary source. DMC generates a finite context state model by adaptively generating a Finite State Machine (FSM) that captures symbol frequencies within the source message. Traditionally DMC has operated on a binary alphabet creating a FSM of binary transitions between states. The compression of DMC is comparable with PPM, which is one of the best compression methods in use today. However because DMC is a bit-wise modeller, it is considerably slower than PPM and requires large amounts of memory to achieve this compression. This thesis extends the bit-wise modeller DMC to a finite character alphabet, which promises to improve compression speed. Considerable attention is given to efficient data structures capable of representing individual states of the FSM. While the performance of Character DMC fails to match bit-wise DMC or PPM, a significant improvement in compression speed can be achieved. Evolving Character DMC to capture variable length phrases was the next approach taken. Several inherent problems involving locating words within each state have surfaced. Again, the comparable compression with PPM was disappointing, and the compression speed was less than half that of Character DMC. A final implementation attempted to avoid the large resource requirements of DMC It achieves this by restricting both the length of the source message, and the amount of memory available for the FSM. Reasonable compression is achieved, at very high speeds. Such an implementation is ideal for network packets, or hard disk block compression.en
dc.identifier.urihttp://hdl.handle.net/10092/9572
dc.identifier.urihttp://dx.doi.org/10.26021/2076
dc.language.isoen
dc.publisherUniversity of Canterbury. Computer Scienceen
dc.relation.isreferencedbyNZCUen
dc.rightsCopyright Robert Fletcher Whiteheaden
dc.rights.urihttps://canterbury.libguides.com/rights/thesesen
dc.titleAn exploration of dynamic Markov compressionen
dc.typeTheses / Dissertations
thesis.degree.disciplineComputer Scienceen
thesis.degree.grantorUniversity of Canterburyen
thesis.degree.levelMastersen
thesis.degree.nameMaster of Scienceen
uc.bibnumber536083en
uc.collegeFaculty of Engineeringen
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
whitehead_thesis.pdf
Size:
5.09 MB
Format:
Adobe Portable Document Format