The effectiveness of conventional data mining techniques for detecting fraud and serious crime is being eroded by the volume and complexity of the data 
(28/10/2009)
Detica has warned that the effectiveness of conventional data mining techniques for detecting fraud and other serious crime is fast being eroded by the volume, speed and complexity of the data they have to process. Instead it argues that ‘next generation’ data mining techniques such as social network analysis need to be used in order to cross-references data from multiple sources to identify patterns of links that are indicative of organised criminal networks.
Addressing the recent annual RSA security conference, in a presentation entitled ‘The end of data mining? Surviving the digital tsunami’, David Porter, one of Detica’s senior security experts, explains: “Although criminals have been quick to exploit the benefits of the digital revolution, so too have those responsible for their disruption. Both governments and large corporations use powerful data mining tools to help detect fraud and other serious crime.”
Porter continues: “However, there is now real concern that the explosion in data volume, complexity and speed is outstripping our ability to make sense of it. This growing digital tsunami means that conventional approaches to data mining developed over the past few decades are hitting a ceiling. The answer is to embrace ‘next generation’ data mining methods such as social network analysis and also re-appraise the role that human intelligence, imagination and experience play in detecting security breaches. By substituting brute-force data interrogation with a smarter, more collaborative human-machine approach we can get to grips with today’s fast-moving security threats more quickly.”
The conference was being organised by RSA, the Security Division of EMC, with the support of the security industry. Originally launched in 1991 as a forum for cryptographers to share the latest knowledge on Internet security, the RSA Conference is helping to drive the information security agenda worldwide with annual industry events in the U.S., Europe and Japan, creating opportunities to tackle the most important IT security issues through first-hand interactions with experts in the field.
Related topics: Data management and data security
Print version | 
Email to a friend | 
Related articles
Data breaches: Trends, costs and best practices gives you all the latest information on securing personal and corporate data, key recommendations for immediate action to improve data security, and how to respond to data breaches.
Other Security news and resources
Security News
Suppliers Directory
Jobs forum
Classifieds
Knowledge base
White papers
Research library
Security books
Special reports
Security interviews
Security companies
Security events
Security links
Security market
Product channels
Access Control Biometrics CCTV Intruder Alarms IT Security Manned Guarding Perimeter Protection Physical Security Remote Monitoring Security Services Fire, Health & Safety Other Security Products
IT Security white papers and research library
Access Control Authentication Data Management Data Security Digital Signatures Email Security Identity Management Internet Security Intrusion Prevention Network Security Remote access security Security Management Security Policies Security Software Security Threats Virus Detection Software Virus Protection VPN Vulnerability Assessment Wireless Security
Security books, guides, standards and toolkits
RFID and Smart Cards books, guides and reference documents Biometric books, guides and reference documents CCTV books, guides and reference documents Intruder alarms and intrusion detection systems books, guides and reference documents Monitoring and surveillance books, guides and reference documents IT Governance, ISO 27001 ISO 17799 and BS 7799 toolkits Fire, Health & Safety books, guides and reference documents
