Hashing fuzzing: introducing input diversity to improve crash detection

Article


Menendez Benito, H. and Clark, D. 2022. Hashing fuzzing: introducing input diversity to improve crash detection. IEEE Transactions on Software Engineering. 48 (9), pp. 3540-3553. https://doi.org/10.1109/TSE.2021.3100858
TypeArticle
TitleHashing fuzzing: introducing input diversity to improve crash detection
AuthorsMenendez Benito, H. and Clark, D.
Abstract

The utility of a test set of program inputs is strongly influenced by its diversity and its size. Syntax coverage has become a standard proxy for diversity. Although more sophisticated measures exist, such as proximity of a sample to a uniform distribution, methods to use them tend to be type dependent. We use r-wise hash functions to create a novel, semantics preserving, testability transformation for C programs that we call HashFuzz. Use of HashFuzz improves the diversity of test sets produced by instrumentation-based fuzzers. We evaluate the effect of the HashFuzz transformation on eight programs from the Google Fuzzer Test Suite using four state-of-the-art fuzzers that have been widely used in previous research. We demonstrate pronounced improvements in the performance of the test sets for the transformed programs across all the fuzzers that we used. These include strong improvements in diversity in every case, maintenance or small improvement in branch coverage – up to 4.8% improvement in the best case, and significant improvement in unique crash detection numbers – between 28% to 97% increases compared to test sets for untransformed programs

PublisherIEEE
JournalIEEE Transactions on Software Engineering
ISSN0098-5589
Electronic1939-3520
Publication dates
Online30 Jul 2021
Print01 Sep 2022
Publication process dates
Submitted10 Jul 2020
Accepted15 Jul 2021
Deposited27 Jul 2021
Output statusPublished
Accepted author manuscript
File Access Level
Open
Copyright Statement

© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Digital Object Identifier (DOI)https://doi.org/10.1109/TSE.2021.3100858
LanguageEnglish
Permalink -

https://repository.mdx.ac.uk/item/89720

Download files


Accepted author manuscript
main_TSE.pdf
File access level: Open

  • 108
    total views
  • 121
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Output sampling for output diversity in automatic unit test generation
Menéndez, H., Boreale, M., Gorla, D. and Clark, D. 2022. Output sampling for output diversity in automatic unit test generation. IEEE Transactions on Software Engineering. 48 (1), pp. 295-308. https://doi.org/10.1109/TSE.2020.2987377
Clustering: finding patterns in the darkness
Menendez Benito, H. 2021. Clustering: finding patterns in the darkness. Open Journal of Machine Learning. 1 (1), pp. 1-28. https://doi.org/10.46723/ojml.v1i1.4
Malware: the never-ending arm race
Menendez Benito, H. 2021. Malware: the never-ending arm race. Open Journal of Cybersecurity. 1 (1), pp. 1-25. https://doi.org/10.46723/ojc.1.1.3
Software testing or the bugs’ nightmare
Menendez Benito, H. 2021. Software testing or the bugs’ nightmare. Open Journal of Software Engineering. 1 (1), pp. 1-21. https://doi.org/10.46723/ojse.1.1.1
Getting ahead of the arms race: hothousing the coevolution of VirusTotal with a Packer
Menendez Benito, H., Clark, D. and T. Barr, E. 2021. Getting ahead of the arms race: hothousing the coevolution of VirusTotal with a Packer. Entropy. 23 (4). https://doi.org/10.3390/e23040395
Assessing stakeholder network engagement
Okazaki, S., Plangger, K., Roulet, T. and Menendez Benito, H. 2021. Assessing stakeholder network engagement. European Journal of Marketing. 55 (5), pp. 1359-1384. https://doi.org/10.1108/EJM-12-2018-0842
Diversifying focused testing for unit testing
Menendez Benito, H., Jahangirova, G., Sarro, F., Tonella, P. and Clark, D. 2021. Diversifying focused testing for unit testing. ACM Transactions on Software Engineering and Methodology. 30 (4), pp. 1-24. https://doi.org/10.1145/3447265
Designing large quantum key distribution networks via medoid-based algorithms
Garcia-Cobo, I. and Menendez Benito, H. 2021. Designing large quantum key distribution networks via medoid-based algorithms. Future Generation Computer Systems. 115, pp. 814-824. https://doi.org/10.1016/j.future.2020.09.037