DATA CLUSTERING BASED ON KEY IDENTIFICATION

Q: How can I download an article?

To download an article from SID, first log in to the site, search for the article title, and click on the 'Download Article' option.

Q: How can I download an ISI article?

To download an ISI article on SID, enter the keyword or article title in the search bar, view the relevant results, click on the desired article, and select the 'Download Article' option.

Q: How can I access the SID database?

To access the SID database, visit SID.ir, create an account, and log in to access scientific resources.

Q: Is downloading articles from SID free?

Some articles on SID are available for free, while others require payment. Details are specified on the article's page.

FAZL ERSI EHSAN; KAZEMI NOOGHABI MASOUD

مرکز اطلاعات علمی Scientific Information Database (SID) - Trusted Source for Research and Academic Resources

Journal Paper

Paper Information

Journal: SIGNAL AND DATA PROCESSING Year:2018 | Volume:14 | Issue:4 (SERIAL 34) Page(s): 31-42

Download Full-Text

Persian Verion

View:

681

Download:

Cites:

Information Journal Paper

Title

DATA CLUSTERING BASED ON KEY IDENTIFICATION

Author(s)

FAZL ERSI EHSAN | KAZEMI NOOGHABI MASOUD | Issue Writer Certificate

Keywords

CLUSTERINGQ2

KEY IDENTIFICATIONQ1

LARGE SCALEQ1

Abstract

CLUSTERING has been one of the main building blocks in the fields of machine learning and computer vision. Given a pair-wise distance measure, it is challenging to find a proper way to identify a subset of representative exemplars and its associated cluster structures. Recent trend on big data analysis poses a more demanding requirement on new CLUSTERING algorithm to be both scalable and accurate. A recent advance in graph-based CLUSTERING extends its ability to millions of data points by massive utility of engineering endeavor and parallel optimization. However, most other existing CLUSTERING algorithms, though promising in theory, are limited in the scalability issue. In this paper, a novel CLUSTERING method is proposed that is both accurate and scalable. Based on a simple criteria, ” key” items that are representative of the whole data set are iteratively selected and thus form associated cluster structures. Taking input of pairwise distance measure between data instances, the proposed method searches centers of clusters by identifying data items far away from selected keys, but representative of unselected data items. Inspired by hierarchical CLUSTERING, small clusters are iteratively merged until a desired number of clusters are obtained. To solve the scalability problem, a novel tracking table technique is designed to reduce the time complexity which is capable of CLUSTERING millions of data points within a few minutes. To assess the performance of the proposed method, several experiments are conducted. The first experiment tests the ability of our algorithm on different manifold structures and various number of clusters. It is observed that our CLUSTERING algorithm outperforms existing alternatives in capturing different shapes of data distributions. In the second experiment, the scalability of our algorithm to LARGE SCALE data points is assessed by CLUSTERING up to one million data points with dimensions of up to 100. It is shown that, even with one million data points, the proposed method only takes a few minutes to perform CLUSTERING. The third experiment is conducted on the ORL database, which consists of 400 face images of 40 individuals. The proposed CLUSTERING method outperforms the compared alternatives in this experiment as well. In the final experiment, shape CLUSTERING is performed on the MPEG-7 dataset, which contains 1400 silhouette images from 70 classes, 20 different shapes for each class. The goal here is to cluster the data items (here the binary shapes) into 70 clusters, so that each cluster only includes shapes that belong to one class. The proposed method outperforms other alternative CLUSTERING algorithms on this dataset as well. Extensive empirical experiments demonstrate the superiority of the proposed method over existing alternatives, in terms of both effectiveness and efficiency. Furthermore, our algorithm is capable of large-scale data CLUSTERING where millions of data points can be clustered in a few seconds.

Cites

No record.

References

No record.

Cite

APA: Copy

FAZL ERSI, EHSAN, & KAZEMI NOOGHABI, MASOUD. (2018). DATA CLUSTERING BASED ON KEY IDENTIFICATION. SIGNAL AND DATA PROCESSING, 14(4 (SERIAL 34) ), 31-42. SID. https://sid.ir/paper/160831/en

Vancouver: Copy

FAZL ERSI EHSAN, KAZEMI NOOGHABI MASOUD. DATA CLUSTERING BASED ON KEY IDENTIFICATION. SIGNAL AND DATA PROCESSING[Internet]. 2018;14(4 (SERIAL 34) ):31-42. Available from: https://sid.ir/paper/160831/en

IEEE: Copy

EHSAN FAZL ERSI, and MASOUD KAZEMI NOOGHABI, “DATA CLUSTERING BASED ON KEY IDENTIFICATION,” SIGNAL AND DATA PROCESSING, vol. 14, no. 4 (SERIAL 34) , pp. 31–42, 2018, [Online]. Available: https://sid.ir/paper/160831/en

Related Journal Papers