Abstract
The structure and behavior of organizations can be learned by mining the event logs of the information systems they manage. This supports numerous applications, such as inferring the structure of social relations, uncovering implicit workflows, and detecting illicit behavior. However, to date, no clear guidelines regarding how to select an appropriate time period to perform organizational modeling have been articulated. This is a significant concern because an inaccurately defined period can lead to incorrect models and poor performance in data-driven applications. In this paper, we introduce a data-driven approach to infer the optimal time period for organizational modeling. Our approach 1) represents the system as a social network, 2) decomposes it into its respective principal components, and 3) optimizes the signal-to-noise ratio over varying temporal observation windows. In doing so, we minimize the variance in the organizational structure while maximizing its patterns. We assess the capability of this approach using an anomaly detection scenario, which is based on the patterns learned from the interactions documented in audit logs. The classification performance of two known algorithms is investigated over a range of time periods in two representative datasets. First, we use the electronic health record access logs from Northwestern Memorial Hospital to demonstrate that our framework detects a period that coincides with the optimal performance of the anomaly detection algorithms. Second, we assess the generalizability of the framework through an analysis with a less clearly defined organization, in the form of the social network inferred from the DBLP co-authorship dataset. The results with this data further illustrate that our framework can discover the optimal time period in the context of a more loosely organized group.
| Original language | English (US) |
|---|---|
| Title of host publication | Proceedings - 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018 |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 46-55 |
| Number of pages | 10 |
| ISBN (Electronic) | 9781538695029 |
| DOIs | |
| State | Published - Nov 15 2018 |
| Event | 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018 - Philadelphia, United States Duration: Oct 18 2018 → Oct 20 2018 |
Publication series
| Name | Proceedings - 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018 |
|---|
Other
| Other | 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018 |
|---|---|
| Country | United States |
| City | Philadelphia |
| Period | 10/18/18 → 10/20/18 |
Fingerprint
Keywords
- Anomaly detection
- Data Mining
- Organizational modeling
- Temporal optimization
ASJC Scopus subject areas
- Hardware and Architecture
- Information Systems and Management
- Safety, Risk, Reliability and Quality
- Computer Networks and Communications
Cite this
}
Mining the best observational window to model social phenomena. / Yan, Chao; Yin, Zhijun; Xiang, Stanley; Chen, You; Vorobeychik, Yevgeniy; Fabbri, Daniel; Kho, Abel N; Liebovitz, David; Malin, Bradley.
Proceedings - 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 46-55 8537816 (Proceedings - 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
TY - GEN
T1 - Mining the best observational window to model social phenomena
AU - Yan, Chao
AU - Yin, Zhijun
AU - Xiang, Stanley
AU - Chen, You
AU - Vorobeychik, Yevgeniy
AU - Fabbri, Daniel
AU - Kho, Abel N
AU - Liebovitz, David
AU - Malin, Bradley
PY - 2018/11/15
Y1 - 2018/11/15
N2 - The structure and behavior of organizations can be learned by mining the event logs of the information systems they manage. This supports numerous applications, such as inferring the structure of social relations, uncovering implicit workflows, and detecting illicit behavior. However, to date, no clear guidelines regarding how to select an appropriate time period to perform organizational modeling have been articulated. This is a significant concern because an inaccurately defined period can lead to incorrect models and poor performance in data-driven applications. In this paper, we introduce a data-driven approach to infer the optimal time period for organizational modeling. Our approach 1) represents the system as a social network, 2) decomposes it into its respective principal components, and 3) optimizes the signal-to-noise ratio over varying temporal observation windows. In doing so, we minimize the variance in the organizational structure while maximizing its patterns. We assess the capability of this approach using an anomaly detection scenario, which is based on the patterns learned from the interactions documented in audit logs. The classification performance of two known algorithms is investigated over a range of time periods in two representative datasets. First, we use the electronic health record access logs from Northwestern Memorial Hospital to demonstrate that our framework detects a period that coincides with the optimal performance of the anomaly detection algorithms. Second, we assess the generalizability of the framework through an analysis with a less clearly defined organization, in the form of the social network inferred from the DBLP co-authorship dataset. The results with this data further illustrate that our framework can discover the optimal time period in the context of a more loosely organized group.
AB - The structure and behavior of organizations can be learned by mining the event logs of the information systems they manage. This supports numerous applications, such as inferring the structure of social relations, uncovering implicit workflows, and detecting illicit behavior. However, to date, no clear guidelines regarding how to select an appropriate time period to perform organizational modeling have been articulated. This is a significant concern because an inaccurately defined period can lead to incorrect models and poor performance in data-driven applications. In this paper, we introduce a data-driven approach to infer the optimal time period for organizational modeling. Our approach 1) represents the system as a social network, 2) decomposes it into its respective principal components, and 3) optimizes the signal-to-noise ratio over varying temporal observation windows. In doing so, we minimize the variance in the organizational structure while maximizing its patterns. We assess the capability of this approach using an anomaly detection scenario, which is based on the patterns learned from the interactions documented in audit logs. The classification performance of two known algorithms is investigated over a range of time periods in two representative datasets. First, we use the electronic health record access logs from Northwestern Memorial Hospital to demonstrate that our framework detects a period that coincides with the optimal performance of the anomaly detection algorithms. Second, we assess the generalizability of the framework through an analysis with a less clearly defined organization, in the form of the social network inferred from the DBLP co-authorship dataset. The results with this data further illustrate that our framework can discover the optimal time period in the context of a more loosely organized group.
KW - Anomaly detection
KW - Data Mining
KW - Organizational modeling
KW - Temporal optimization
UR - http://www.scopus.com/inward/record.url?scp=85059775063&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85059775063&partnerID=8YFLogxK
U2 - 10.1109/CIC.2018.00-41
DO - 10.1109/CIC.2018.00-41
M3 - Conference contribution
AN - SCOPUS:85059775063
T3 - Proceedings - 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018
SP - 46
EP - 55
BT - Proceedings - 4th IEEE International Conference on Collaboration and Internet Computing, CIC 2018
PB - Institute of Electrical and Electronics Engineers Inc.
ER -