Search published articles


Showing 16 results for Evaluation

Dr Saeed Ghaffari, Dr Masoud Bakhtiari,
Volume 0, Issue 0 (5-2022)
Abstract

Purpose: The purpose of this research is to discover the state of the user interface in the web pages of digital libraries and to provide a model for the libraries of Payam Noor University based on the criteria found in the texts and sources.
Research method: The research method is survey and descriptive. The research tool used to evaluate libraries is the Nowruz check list (2018) consisting of 10 main criteria and 114 sub-components. The statistical population of the research is 10 digital libraries in America, Australia, France, Switzerland, New Zealand, Holland, Poland, Japan, India and Italy. Descriptive statistics and SPSS and Excel software were used to analyze the data of this research. Also, the questions and hypothesis of the research were tested by using t-test and Friedman's test.
Research findings: The digital library of America has won the first rank in compliance with the standards with 70.42%. Then the digital libraries of France with a score of 62.07 and Switzerland with a score of 61.59% are in the second and third places. Italian digital libraries are at the bottom of these libraries with 40.14% compliance. Also, among the criteria, the interface language criterion with 35.98% of compliance has been paid more attention by libraries than other criteria. The criterion of user control with 6.70% compliance has the lowest compliance rate among libraries.
Conclusion: In the libraries of Payam Noor University, in addition to following the general search components, special components such as proximity search, related keyword suggestions, and marking of search results are suggested in order to save the user's time. Also, the existence of the site map, information display criteria, reducing the time spent by the user and attracting and maintaining the user need attention.

Faeze Delghandi, Ghasem Azadi Ahmadabadi,
Volume 1, Issue 2 (7-2014)
Abstract

Background and Aim: Interaction in a digital library help users locating and accessing information and also assist them in creating knowledge, better perception, problem solving and recognition of dimension of resources. This paper tries to identify and introduce the components and elements that are used in interaction between user and system in search and retrieval of information in digital library.
Method: This paper investigate the different studies in the field of interactive search of digital library by the library approach and also identifies capabilities that can be used in digital library by the use of heuristic methods.
Results: The components of identified, interactive search including: 1. Interaction before search including using directories, applying ontology, and filtering. 2. Interaction in the time of search including annotation, suggesting the interactive terms by the use of subjective thesaurus. Syndicate list, colon searching, filtering. Interaction after search: motion, fragment, copying, collecting, cutting, segmentation, probing, rearrangement, re illustration, searching, visualization based on graph, personalization and recommendation systems.
Conclusion: With perception of interaction and interactive search, the efficient design and evaluation of digital library can be done. The designers of digital libraries can use different interaction according their resources. Librarian also can familiar with different interaction and would be able to give their users necessary education until they can search and retrieval efficiently.
Zeinab Sedighi, Alireza Isfandyari-Moghaddam, Atefeh Zarei,
Volume 3, Issue 2 (9-2016)
Abstract

Purpose: Digital library user interfaces has a determining role in desirable performance of this kind of libraries. Digital Library service providers to the blind and deaf users will have their best performance when the users (deaf and blind users) could have a proper interaction with them. This study aims to evaluate and analyze the criteria related to user interface in digital libraries service provider to the blind and deaf users in the world.

 Methodology: This is an applied and evaluative study. This study has been used library research method for extracting criteria and descriptive survey method for everything from evaluating library. A checklist consist of 13 criteria (Screen capabilities, Ability of organizing the screen, Search facilities, Links, Visual symbols and images, Options for customizing the texts, Help services and Tips, Error message alert, Interaction and feedback facilities, user interface Language, User controls, Library resources in various format, Study facilities of retrieved resources from the library) and 109 component is prepared. Then have been finalized by using the Delphi method and completed for each Library. 12 digital library service providers to blind and deaf user in the world perform the population.

Finding: Results of the study showed that the criteria of '' user interface language '' (with 97.92 %) and the criteria of '' user control'' (with 9.67 %) reached the highest and lowest scores respectively. Among the 12 digital libraries investigated worldwide, "Digital library for the blind" with respect 63.53 reached the maximum and "U.S. National Library Service for Blind" with respect 37.62 grasped the minimum levels.


Hamid Keshavarz, Fatemeh Fahimnia, Alireza Nouruzi, Mohammadreza Esmaeili Givi,
Volume 3, Issue 3 (12-2016)
Abstract

Background and Aim: The current research aims to develop a literature-dependent and expert-modified model related to credibility evaluation of web information.

Methods: Regarding the approach, mixed method would be utilized. The research method then is mixed-heuristic using both qualitative and quantitative methodologies. In the first stage of the research, meta- synthesis was used as a qualitative research method. Secondly, exploring experts’ points of view was conducted by a Delphi method to develop the conceptual model identified in the first stage.

Results: Using the seven stage mode of meta-synthesis, a model was designed in four layers including concepts, categories, codes and indicators. A set of 68 indicators were incorporated into the different layers of the model. For reliability testing of the conceptual mopdel, a Delphi study was conducted in two rounds after which the comments of the experst were included into the model. Regarding the high degree of Kendall’s coeficinet of concordance about %.65 and the agreement perecentage of the most dimensions of the model higher than %90 the conceptual model was confirmed by the sample experts.

Conclusion: The conceptual model derived from the meta-synthesis and Delphi studies is a model accepted by experts and a base for future research to design some tools for related studies. The findings showed that the credibility evaluation is a concept whith different and multiple dimensions and components suitable for users, designers and policymakers to take them into consideration in design and evaluation of web resources.


Mohsen Nowkarizi, Mr Mahdi Zeinali,
Volume 4, Issue 3 (12-2017)
Abstract

Background and Aim: The aim of this study was to measure the overlap of 4 local Persian search engines of Parsijoo, Yooz, Parseek, and Rismoun and to compare the capabilities of these engines in covering indexable web.
Methods: This was an applied and evaluative research. To collect data, a keyword-based method was used. First, the selected keywords were entered into the search engines and then a sample was extracted of the retrieved records. Finally, based on the existence or absence of these records in the search engines, the necessary data were gathered. Accordingly to analyze the data, inferential statistical methods were used.
Results: The relative overlap of the Parseek compared to that of Parsijoo and Parsijoo's one compared to Yooz was 26 percent on average and Parseek had the most recall. Rismoun had not any common records with the other investigated search engines. Three search engines (Parseekc, Parsijoo and Yooz retrieved 27 common records out of 225 recalled records; there was a significant difference between the relative overlap of the 4 search engines. Also, on average, Parseel, Parsigoo, Yooz and Rismoun covered respectively 38, 31, 26, and 6 percent of the indexable web. There was a significant difference between the coverage of the 4 search engines.
Conclusion: It seems that each search engine has a different indexing policy, and users need to search for more than one search engine to get comprehensive information about an issue. It can be predicted that by foraging in two search engines, Parseek and Parsijoo, one may access 70 percent of the indexable web.
Hashem Atapour, Fatima Fahimnia,
Volume 5, Issue 1 (6-2018)
Abstract

Background and Aim: this research investigates the impact of authors’ rank in Bibliographic networks on document-centered model of Expertise Retrieval. Its purpose is to find out what kind of authors’ ranking in bibliographic networks can improve the performance of document-centered model.  
Methodology: Current research is an experimental one. To operationalize research goals, a new test collection was developed which includes 55 queries and 96375 documents. The queries were made by Iran Knowledge and Information Science PhD students, and the documents were papers indexed in the Web of Science database under Library Science and Information Science category. The queries were submitted to the database consisting of test collection documents, and then DLH13, a known IR model, were used to retrieve documents from database. The first 100 documents retrieved by DLH13 model for each query were chosen for second stage. All people names occurred in the retrieved documents were extracted, processed, and ranked in 5 different ways based on micro metrics of Social Network Analysis. The top 10 results of every method accumulated in a pool of authors. After relevance judgment on authors’ expertise, the expert finding performance of every ranking method was measured.
Findings: Results showed that performance of authors’ ranking in citation networks hadn’t significant difference with document-centered model, whereas authors’ ranking in co-authorship networks was weaker than document-centered model, and impact it negatively.   
Conclusion: compared with author-based networks, citation-based networks are better evidence for individual’s expertise in different subject areas. 
Fatemeh Zandian, Leyla Fathi, Mohammad Hasanzadeh,
Volume 5, Issue 2 (9-2018)
Abstract

Background and Objectives: Today, websites with diverse and varied uses have revolutionized all social, scientific, educational, artistic, commercial, and other fields of thought. In the meantime, the cinema has not gone away with this technological advancement, and a large number of cinema websites have been set up to help film makers in this field. Whatever the users of a website, the main purpose and the main goals is to provide quick and easy service and to satisfy users, and this goal is achieved only with the assurance of their efficiency and performance review and performance measurement. Web sites are not possible except by evaluating them. Only this way, one can see the strengths and weaknesses of the Web sites, and they have taken steps to refine or complete their progress and development. The purpose of this study was to evaluate the cinematic websites of Iran based on the three-level pyramid model.
Methodology: Using evaluative method, 38 Iranian cinemas were evaluated using two public and specialized criteria. Using these two logos, not screening, navigation, content, availability, interaction, informational services, special services, multimedia services, and customer service have been evaluated.
Results: The evaluation results show that Iran's cinema websites are based on the three-level pyramid model, which are general criteria, at a good level, in the middle of the pyramid with appropriate specialized standards at the head of the pyramid consisting of Specialized criteria are at the right level.
Conclusion: A fully cinematic web site is considered to include at least two criteria for special services and customer service at the head of the pyramid, one in a highly professional and user-friendly manner, and at the level of the best of the same foreign websites Have your website. It seems that Iran's cinematic websites are beginning to work on this and need more activity and experience.

Dr Azam Sanatjoo, Mr Mahdi Zeynali Tazehkandi,
Volume 7, Issue 2 (12-2020)
Abstract

Purpose: There are several metrics for evaluating search engines. Though, many researchers have proposed new metrics in recent years. Familiarity with new metrics is essential. So, the purpose is to provide an analysis of important and new metrics to evaluate search engines.
Methodology: This review article critically studied the efficiency of metrics of evaluation. So, “evaluation metrics,” “evaluation measure,” “search engine evaluation,” “information retrieval system evaluation,” “relevance evaluation measure” and “relevance evaluation metrics” were investigated in “MagIran” “Sid” and Google Scholar search engines. Articles gathered to inspect and analyse existing approaches in evaluation of information retrieval systems. Descriptive-analytical approach used to review the search engine assessment metrics.
Findings: Theoretical and philosophical foundations determine research methods and techniques. There are two well-known “system-oriented” and “user-oriented” approaches to evaluating information retrieval systems. So, researchers such as Sirotkin (2013) and Bama, Ahmed, & Saravanan (2015) group the precision and recall metrics in a system-oriented approach. They also believe that Average Distance, normalized discounted cumulative gain, Rank Eff and B pref are rooted in the user-oriented approach. Nowkarizi and Zeynali Tazehkandi (2019) introduced comprehensiveness metric instead of Recall metric. They argue that their metric is rooted in a user-oriented approach, while the goal is not fully met. On the other hand, Hjørland(2010) emphasizes that we need a third approach to eliminate this dichotomy. In this regard, researchers such as Borlund, Ingwersen (1998), Borlund (2003), Thornley, Gibb (2007) have mentioned a third approach for evaluating information retrieval systems that refer to interact and compose two mentioned approaches. Incidentally, Borlund, Ingwersen(1998) proposed a Jaccard Association and Cosine Association measures to evaluate information retrieval systems. It seems that these two metrics have failed to compose the system-oriented and user-oriented approaches completely,  and need further investigation.
Conclusion: Search engines involve different components including: Crawler, Indexer, Query Processor, Retrieval Software, and Ranker. Scholars  wish to apply the most efficient search engines for retrieving required information resources. Each   metrics measures a specific component, to measure all, it is suggested to select metrics from all three mentioned groups in their search.
Mr Mahmoud Pouyanfar, Dr Mohammad Reza Kiani, Dr Mohammad Javad Hashemzadeh,
Volume 7, Issue 2 (12-2020)
Abstract

Purpose: Today, social networks and smart phones have become very popular. One of the interesting topics in the field of information science and cognition is the study of users' information behavior in mobile-based social networks. In this area, this study examines the role of psychological variables: communication Apprehension, Expression of the True Self, and Fear of Negative Evaluation in Instagram and Selfie use. The main purpose of this study was to investigate the role of communication Apprehension, Expression of the True Self, and Fear of Negative Evaluation in Instagram and Selfie use from the perspective of undergraduate students of Birjand University.
Methodology: This correlational study used 4 questionnaires "Communication Apprehension" (McCroskey, 1982), "Fear of Negative Evaluation" (Leary, 1983), " Instagram Use " (Lazebna, 2015) and "Taking a selfie" (Lazebna, 2015) (online) in a random sample of undergraduate students at the University of Birjand (357 participants).
Findings: Communication Apprehension and selfie use were significantly higher in women than in men. However,  there was no significant differences shown for  the other variables.  Instagram usage was above average and sending  and edited selfies were below average. The increase of most of the psychological variables investigated also showed the increase of use of Instagram, selfies and edited selfies. Also, with the increase of communication apprehension, the fear of  negative evaluation increased.
Conclusion: Review of the literature revealed that  there wasn’t any interest in the field of  knowledge and information science for the topic at the national level. Although, there were limited studies presented in the international arena.
Samira Daniali, Dr. Amir Hossein Seddighi,
Volume 8, Issue 2 (9-2021)
Abstract

Background: The purpose of this study is to evaluate the University of Tehran website based on information architecture indicators to inform, assess the status and quality of the website.
Methodology: The research method is applied descriptive. Checklist was used to analyze the website in terms of organization, labeling, navigation, and search systems.
Findings: The results of the checklists showed that the University of Tehran website earned 20 points out of 37 in the organization, 37 points out of 57 in the labeling, 53 points out of 78 in the navigation, and 14 points out of 46 in the search, which imply a poor status in search system, an average status in organization system, and a good status in labeling and navigation systems. According to the obtained results, the search system of the University of Tehran website can be redesigned, its organization system can be reviewed, and other mentioned systems can be improved. In general, in order to increase the efficiency of websites, it is necessary to consider the principles of information architecture in their design. Moreover, this research can be a suitable source for future website policies by identifying the strengths and weaknesses of the website.
Conclusion: Evaluating the information architecture of a website is a new field that, while important, has received less attention. This research tries to show the applicability of the method for use in similar cases by presenting a systematic evaluation in a case study for the University of Tehran website while introducing the strengths and weaknesses of this website.
 
Dr. Mohammad Moradi, Dr. Mojtaba Mazoochi,
Volume 8, Issue 4 (2-2022)
Abstract

Purpose: The purpose is to present an open government data evaluation method by considering comprehensive and complete dimensions and criteria - calculating the weight and importance of each criterion, examining the country in this area, clustering organizations and presenting a classification model to predict the situation.
Methodology: Library studies was used to extract the dimensions and criteria of evaluation. Population includes articles related to open government data evaluation criteria. Ten articles were reviewed by simple random sampling method. Multiple attribute decision making techniques was used to calculate the weight and importance of each criterion. Data mining techniques was incorporated to cluster and create a classification model.
Findings: By reviewing the articles 15 criteria of open government data evaluation including:  Data originality, license openness, up-to-datedness, data access rate, metadata completeness, number of data sets, format openness, non-discriminatory, comprehensible, number of data fields, free, no missing data, data request ability, visual and feedback, were extracted. Using AHP technique, the weights of the criteria were calculated, which after normalization, the total weight of the 15 extracted criteria was equal to one. "Data originality" with a weight of 0.165, " license openness " with a weight of 0.124 and " up-to-datedness" with a weight of 0.109 were ranked first to third among 15 evaluation criteria, respectively. Weight of evaluation criteria obtained and data extraction of 358 organizations in harmony with 15 evaluation criteria, the weight of organizations was calculated. The sum of the weights was equal to one. "East Azerbaijan Agricultural Jihad Organization" with a weight of 0.088, "Statistics Center of Iran" with a weight of 0.062 and "Geological Survey" with a weight of 0.058 were the first to third ranks among 358 organizations and government institutions, respectively, based on the combination of criteria and the weight of criteria.
Conclusion: Evaluation criteria obtained, calculating the weight and importance of each criterion, examining the current situation of government organizations and institutions in the country and the classification model created can help managers to understand the current situation and improve it and thus increase citizens' interaction with open government data as a kind of human information interaction.

Dr. Ali Naimi-Sadigh, Dr. Mohammad Rabiei, Dr. Alireza Seghatoleslami,
Volume 9, Issue 2 (9-2022)
Abstract

Objectives: The National Conference of Information Technology Managers is conceivably the most significant of its nature in the country. Chief competitive advantage to comparable ones is its observant of products in IT as an alternative to papers. The purpose is a comprehensive design for the scientific evaluation of information technology products.
Method: For the evaluation plan of the premium information technology award (FAB), three main scientific-technological, managerial-economical and cultural-social axes were studied.  At the end, the criteria and sub-criteria were interviewed using the experts' focus group method. Initially, the information technology products were classified according to their nature.  Then, the importance of criteria and sub-criteria were determined for all their features. Finally, evaluation of the products was done based on their identified importance.
Findings: The products are divided into 9 groups according to the type of customer and the product usage. Each of these 9 groups will have unique features and different sub-criteria. They receive their total weight by points given via expert judges that will be their score compared to the other products, and therefore could rank the products.
Conclusion: After receiving the products, in the first stage, they are evaluated in the internal scientific evaluation committee of the conference. In the next stage, the products receiving the highest points are for the evaluation of the presence of internal and external judges.

 
Professor Saleh Rahimi, Ms Fatemeh Rahimi, Samira Daniali,
Volume 9, Issue 3 (10-2022)
Abstract

Purpose: Due to increasing the amount of information and the importance of applying images in various fields, the significance of visual literacy is obvious and research showed that visual literacy has a positive effect on learning. So, the purpose of this study was to determine the importance of visual literacy and to identify the necessity of its use in education and learning, as well as to dictate the components of visual literacy to improve learning.
Methodology: Using the library method and utilizing descriptive research method, the literature in the field of visual literacy has been reviewed
Findings: Visual literacy is typically considered as an ability to evaluate, analyze and interpret the meanings of images and their use, also as a main concept is contemplated.
Conclusion: Visual literacy standards help us study, analyze, understand, and recognize visual elements based on a reasonable and pre-defined framework. It makes people benefit more appropriately from information resources in the form of symbols and images. The concept of visual literacy is evolving and requires more advanced tools. Therefore, students must be acquainted with the tools of this technique.

Nosrat Riahinia, Farzaneh Shadanpour, Keyvan Borna, Gholam Ali Montazer,
Volume 9, Issue 3 (10-2022)
Abstract

Purpose: This study investigates the automatic keyword extraction from the table of contents of Persian e-books in the field of science using LDA topic modeling, evaluating their similarity with the golden standard, and users' viewpoints of the model keywords.
Methodology: This is mixed text-mining research in which LDA topic modeling is used to extract keywords from the table of contents of scientific e-books. The evaluation of the used approach has been done by two methods of cosine similarity computing and qualitative evaluation by users.
Findings: Table of contents are medium-length texts with a trimmed mean of 260.02 words, about 20% of which are stop-words. The cosine similarity between the golden standard keywords and the output keywords is 0.0932 thus very low. The full agreement of users showed that the extracted keywords with the LDA topic model represent the subject field of the whole corpus, but the golden standard keywords, the keywords extracted using the LDA topic model in sub-domains of the corpus, and the keywords extracted from the whole corpus were respectively successful in subject describing of each document.
Conclusion: The keywords extracted using the LDA topic model can be used in unspecified and unknown collections to extract hidden thematic content of the whole collection, but not to accurately relate each topic to each document in large and heterogeneous themes. In collections of texts in one subject field, such as mathematics or physics, etc., with less diversity and more uniformity in terms of the words used in them, more coherent and relevant keywords are obtained, but in these cases, the control of the relevance of keywords to each document is required. In formal subject analysis procedures and processes of individual documents, this approach can be used as a keyword suggestion system for indexing and analytical workforce.
 
Dr. Amir Hossein Seddighi,
Volume 9, Issue 4 (1-2023)
Abstract

Purpose: As mission-oriented organizations, research institutes have the task of answering community questions in specialized areas, and should therefore be able to effectively present their outputs to their target users. Achieving such a goal requires the proper use of information architecture principles to properly organize the information platform in which the research institutes interact with their audiences. Therefore, reviewing and evaluating the information architecture of Research Institutes’ websites as their main communication platform with their users is of particular importance. The purpose of this study is to evaluate the Iranian Research Institute for Information Science and Technology’s website based on information architecture.
Methodology: The research method is based on content analysis and case evaluation and is done using direct observations and checklists in March 2022. In this regard, first the components of the information environment, ie the context, content, and user of the website are identified. Then, we check the information architecture subsystems of the website using checklists based on the components of the information environment. The organization system checklist contains 14 main questions, the labeling system checklist contains 32 main questions, the navigation system checklist contains 20 main questions, and finally, the search system checklist contains 41 main questions. The checklists were prepared using the library research method and approved by an expert panel. Excel software is used to collect and analyze data.
Findings: Users of the Iranian Research Institute for Information Science and Technology’s website can be categorized into four groups: researchers and students, science and technology policymakers, librarians and informants, and educational and research institutions. The main content of this website includes reports, books, articles, research projects, information systems, scientific events, training courses, laboratories, and collaborative services. The context of the website is based on service development and delivery in the areas of knowledge management, scientific and technological information management, dissemination of information science and technology, supporting science and technology policymakers, Publicizing the use of information technology, cooperating with universities and research institutes, and supporting research in the field of information science and technology. The results of the checklists indicate the score of this website for the organization system, the labeling system, the navigation system, and the search system as 67.6%, 68.4%, 65.4%, and 34.8%, respectively.
Conclusion: The status of the Iranian Research Institute for Information Science and Technology’s website is assessed as good in terms of the organization system, the labeling system, and the navigation system, and poor in terms of the search system. The use of an audience-oriented organization plan in the website organization system, the use of index labels in the form of unique entities in the website labeling system, and the use of a main navigation bar with an integrated and similar design in the website navigation system are among the strengths of the website information architecture design. On the other hand, according to the research findings, to improve the search system, it is necessary to pay attention to features such as “correcting spelling errors in the input query”, “highlighting the input query in the retrieved results”, “adding logical operators to the search system”, “searching metadata”, “sorting results in alphabetical and chronological order”, and “adding search filters such as subject and year”.
 

Samira Daniali, Amir Hossein Seddighi,
Volume 10, Issue 4 (3-2024)
Abstract

Background and Aim: Data as a strategic asset in any organization requires proper and effective management in order to provide transformative opportunities for the organization. In addition, the increase in the volume of data has forced organizations to move towards collecting, classifying and analyzing data so that they can identify the customer's needs and respond to them at the right time and in the right way. On the one hand, to manage such a volume of data and on the other hand, to maximize the business value resulting from the analyses based on these data, a concept called data governance has been introduced. Data governance is a system for determining the responsibilities, policies and standards used in connection with data-driven processes at the organization level, which tries to take steps to transform organization's data into business values while maintaining and increasing the quality of data. From this point of view, data governance is considered as a strategic program that aims to guide and monitor the various data dimensions of the organization in order to solve internal problems around data, and to improve collaboration between business and information technology departments. It will lead to increase productivity in data management and use, and help generate value by pushing the organization towards data-driven decisions. Considering the importance and role of data governance, organizations need to have a clear picture of their situation in this field. Therefore, the need for an approach that can evaluate data governance in organizations is strongly felt. For this purpose, this research tries to find an answer to this need by developing a model for evaluating data governance.
Method: In this research, first, a set of criteria for evaluating data governance is extracted from the literature, and according to the structure of the problem and the opinion of experts, a hierarchical structure is developed for evaluating data governance. Then the evaluation method is established using the proposed structure and a hybrid approach based on Analytic Hierarchy Process (AHP) and Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS). In the following, the proposed approach is used in a case study in the food industry.
In the evaluation method, first, the weight of each criterion is calculated with the help of AHP. In this regard, the following steps are taken.
  • Form a hierarchy
  • For the elements of each level of the hierarchy, perform pairwise comparisons according to the expert opinion.
  • Calculate the inconsistency rate for each matrix of pairwise comparisons.
  • If the inconsistency rate for the matrix was more than 0.1, review the values of the paired comparisons of that matrix.
  • Calculate the relative weight of the elements corresponding to each matrix of pairwise comparisons.
  • The product of the relative weight of each criterion and the relative weight of all elements related to it, at all higher levels of the hierarchy, gives the final weight of that criterion.
  • Now, with the help of the weights calculated for each criterion and using the TOPSIS method, the alternatives will be ranked. The TOPSIS method is based on choosing the alternative that has the smallest distance from the positive ideal solution and the largest distance from the negative ideal solution. In this method, it is assumed that there are m alternatives (organizations) that must be evaluated based on n criteria. The steps of this method are as follows.
  • Evaluate the alternatives with respect to each criterion according to the expert opinion.
  • Normalize the decision matrix so that the data are on the same scale.
  • Obtain the normalized weighted decision matrix by multiplying each component of the normal matrix by the weight of similar criteria.
  • Calculate positive ideal and negative ideal solutions.
  • Calculate the distance of each alternative from the ideal positive and ideal negative solutions.
  • Obtain the closeness coefficient of the alternatives.
  • Rank the alternatives in decreasing order of the closeness coefficient.
  • Finally, the proposed evaluation method is used to evaluate data governance in five organizations active in the food industry.
    Findings: According to the results of this research, data governance can be evaluated at the first level from three different dimensions, which are data quality, internal organizational effects, and external organizational effects. Then, at the second level, different criteria are considered for each dimension of data governance. Data quality evaluation criteria include data accuracy, data completeness, data consistency, data availability, data timeliness, and data uniqueness. The data accuracy measure refers to issues such as the percentage of incorrect information, the percentage of the need for manual corrective actions on the data, and the percentage of change in the retrieval of incorrect information after the implementation of data governance. The data completeness criterion seeks to ensure the completeness of various dimensions of information that the organization must use in its business line, and is related to issues such as the percentage of information filled in the required fields, the percentage of usable information, and the percentage of incomplete information. Data consistency refers to ensuring that the data is consistent and aligned with the policies, rules and values set for the data in the business. Data availability seeks to assess the time the business group has access to critical information and data elements.
    Data timeliness refers to the degree to which the data represents reality at a particular point in time.
    Data uniqueness means that no information item is recorded more than once in the data set.
    The second dimension of data governance evaluation focuses on its internal organizational effects,andthe main criteria in this dimension are data governance efficiency, data governance productivity, and business cost savings. These criteria seek to evaluate the level of involvement, participation and impact of data governance in the organization. Among the important things in evaluating the efficiency of data governance are the number of business lines, functional areas, system areas, project teams, and other parts of the organization that have come together to support monitoring and providing resources for data governance, and in addition, categorizing and tracking the status of all issues that fall within the scope of data governance tasks. The data governance productivity considers the impact of data governance in relation to the amount of support and investment in this area, and includes issues such as the amount of reduction in resources required to coordinate members, products and other entities in data systems, the amount of reduction in work required to solve existing data problems, the percentage of projects or initiatives within the organization that have been identified and eliminated as redundant by the data governance program, and the number of redundant systems eliminated in order to create a single definition of customer, product, or other master data. Finally, the cost savings measure reflects the business value of data governance in terms of internal organizational impacts.
    The third dimension of data governance evaluation considers the effects that go beyond the internal boundaries of the organization and affect the entire business of the organization. The criteria considered in this dimension include obtaining and improving customer satisfaction, complying with laws and creating business opportunities, which express the main motivations and drivers of the organization to adopt data governance in the current competitive environment. The customer satisfaction criterion measures the fruit of the efforts made to govern and manage data and turn it into a real business value. On the other hand, there are laws and regulations that are defined in relation to data and depending on the type of business at different national, regional and international levels, and failure to comply with them, in addition to monetary fines, will sometimes result in the suspension or even termination of the organization's business. Therefore, the level of compliance with laws is one of the key criteria in the evaluation of data governance from the perspective of external organizational effects. Finally, it is expected that high-quality data along with analysis and reporting systems will lead to informed decisions and data-driven insights and provide new business opportunities for the organization, which is the subject of the last criterion in this dimension.
    Finally, five organizations active in the food industry were examined from the perspective of data governance. According to the information collected from these organizations and using expert opinion, pairwise comparisons were made at different levels of the proposed hierarchy. Then, using AHP, the weight of each dimension and criteria was calculated. According to the results, it can be seen that the external organizational effects is the most important dimension of data governance evaluation in organizations. In addition, customer satisfaction was chosen as the most important evaluation criterion, and compliance with laws and productivity were placed in the next positions. Then, the solutions and the distance of each organization from these solutions were calculated. studied organizations were scored based on the data governance criteria on a scale between zero and ten, and using the TOPSIS method, ideal positive and ideal negative  Afterwards, the closeness coefficient and accordingly the rank of each organization was obtained.The results show that the third organization has the best performance in the field of data governance among other organizations, and
    the second and fourth or ganizations are placed in the next places with a slight difference from each other.
    The fifth organization has a much weaker performance and the first organization is in the last place by a large margin. These results emphasize the applicability of the proposed approach for evaluating data governance and show the steps to perform such an evaluation in a case study in the field of food industry. Such an evaluation in the target organizations can be used as a measure to determine the current state of data governance on the one hand, and on the other hand, it can be used to set goals to reach the desired state in data governance. Moreover, considering the comprehensive and general nature of the proposed approach, it enables its application in other organizations, regardless of their size and type, which is one of the advantages of this approach.
    Conclusion: The volume of data is exploding in the last decade and its complexity is continuously increasing. Moreover, organizations have become more adept at using data, which has created new demands that require different methods to combine, change, store and present information. Leading organizations are finding that traditional solutions for data management are becoming more expensive and unable to truly manage the business. Therefore, organizations need to solve these data problems in another way and by implementing an effective data governance. Data governance, by monitoring data quality and aligning it with business goals, is one of the causes of internal organizational changes, such as increased productivity. It has external impacts like increasing customer satisfaction and creating new business opportunities. Therefore, organizations need to use, implement, and evaluate data governance in their business to maintain competitive advantage and comply with laws and regulations. The present study tried to provide an applicable approach to evaluate data governance in organizations. For this purpose, the dimensions of data governance and different criteria for their evaluation were determined using the literature review and the opinion of experts. Then, a hierarchical structure was proposed to evaluate data governance. This structure considers data governance from the three dimensions of data quality, internal organizational effects and external organizational effects of data governance. In the following, for each of these dimensions and depending on their nature, different criteria were introduced and explained. Then the evaluation method was developed based on the obtained structure and using a hybrid AHP and TOPSIS approach. In the next step, the proposed approach was used in a case study to evaluate data governance in five organizations active in the food industry. This study, while showing the implementation steps of the proposed approach, specifies its applicability and generalizability in other organizations. In addition, the results of this evaluation can help organizations to improve the state of data governance and while ensuring customer satisfaction and compliance with laws in the field of data, provide a platform for organizational excellence and new business opportunities.


Page 1 from 1     

© 2024 CC BY-NC 4.0 | Human Information Interaction

Designed & Developed by : Yektaweb