Search published articles


Showing 15 results for Evaluation

Dr. Samira Daniali, Dr. Amir Hossein Seddighi,
Volume 0, Issue 0 (5-2022)
Abstract

Objective: Data as a strategic asset in any organization requires proper and effective management to provide transformational opportunities for the organization. In this regard, data governance is seeking strategic value creation from the organization's data by identifying the policies, processes, and responsibilities related to data. Effective data governance requires evaluation, and the purpose of this research is to provide a method for evaluating data governance in organizations.
Methodology: In this research, first, a model for evaluating data governance is proposed in the form of a hierarchical structure, using the results of previous researches. Then, the evaluation method is established using the proposed structure and a hybrid approach based on Analytic Hierarchy Process and TOPSIS. The proposed approach is used in a case study in the food industry.
Findings: According to the results of this research, data governance can be evaluated from three different dimensions, including data quality, internal organizational effects, and external organizational effects. Data quality evaluation criteria include accuracy, completeness, consistency, availability, robustness and uniqueness of data. The data governance effectiveness, data governance productivity and business cost savings criteria refer to the internal organizational effects. The obtaining and improving customer satisfaction, compliance with laws and creating business opportunities criteria are also related to external organizational effects.
Conclusion: Data governance, by monitoring data quality and aligning it with business goals, is one of the causes of intra-organizational changes, such as increased productivity, in one hand and on the other hand has external impacts like increasing customer satisfaction and creating new business opportunities. Therefore, organizations need to use, implement, and evaluate data governance in their business to maintain competitive advantage and compliance with laws and regulations. This study tried to provide an applicable approach to evaluate data governance in organizations

Dr Saeed Ghaffari, Dr Masoud Bakhtiari,
Volume 0, Issue 0 (5-2022)
Abstract

Purpose: The purpose of this research is to discover the state of the user interface in the web pages of digital libraries and to provide a model for the libraries of Payam Noor University based on the criteria found in the texts and sources.
Research method: The research method is survey and descriptive. The research tool used to evaluate libraries is the Nowruz check list (2018) consisting of 10 main criteria and 114 sub-components. The statistical population of the research is 10 digital libraries in America, Australia, France, Switzerland, New Zealand, Holland, Poland, Japan, India and Italy. Descriptive statistics and SPSS and Excel software were used to analyze the data of this research. Also, the questions and hypothesis of the research were tested by using t-test and Friedman's test.
Research findings: The digital library of America has won the first rank in compliance with the standards with 70.42%. Then the digital libraries of France with a score of 62.07 and Switzerland with a score of 61.59% are in the second and third places. Italian digital libraries are at the bottom of these libraries with 40.14% compliance. Also, among the criteria, the interface language criterion with 35.98% of compliance has been paid more attention by libraries than other criteria. The criterion of user control with 6.70% compliance has the lowest compliance rate among libraries.
Conclusion: In the libraries of Payam Noor University, in addition to following the general search components, special components such as proximity search, related keyword suggestions, and marking of search results are suggested in order to save the user's time. Also, the existence of the site map, information display criteria, reducing the time spent by the user and attracting and maintaining the user need attention.

Faeze Delghandi, Ghasem Azadi Ahmadabadi,
Volume 1, Issue 2 (7-2014)
Abstract

Background and Aim: Interaction in a digital library help users locating and accessing information and also assist them in creating knowledge, better perception, problem solving and recognition of dimension of resources. This paper tries to identify and introduce the components and elements that are used in interaction between user and system in search and retrieval of information in digital library.
Method: This paper investigate the different studies in the field of interactive search of digital library by the library approach and also identifies capabilities that can be used in digital library by the use of heuristic methods.
Results: The components of identified, interactive search including: 1. Interaction before search including using directories, applying ontology, and filtering. 2. Interaction in the time of search including annotation, suggesting the interactive terms by the use of subjective thesaurus. Syndicate list, colon searching, filtering. Interaction after search: motion, fragment, copying, collecting, cutting, segmentation, probing, rearrangement, re illustration, searching, visualization based on graph, personalization and recommendation systems.
Conclusion: With perception of interaction and interactive search, the efficient design and evaluation of digital library can be done. The designers of digital libraries can use different interaction according their resources. Librarian also can familiar with different interaction and would be able to give their users necessary education until they can search and retrieval efficiently.
Zeinab Sedighi, Alireza Isfandyari-Moghaddam, Atefeh Zarei,
Volume 3, Issue 2 (9-2016)
Abstract

Purpose: Digital library user interfaces has a determining role in desirable performance of this kind of libraries. Digital Library service providers to the blind and deaf users will have their best performance when the users (deaf and blind users) could have a proper interaction with them. This study aims to evaluate and analyze the criteria related to user interface in digital libraries service provider to the blind and deaf users in the world.

 Methodology: This is an applied and evaluative study. This study has been used library research method for extracting criteria and descriptive survey method for everything from evaluating library. A checklist consist of 13 criteria (Screen capabilities, Ability of organizing the screen, Search facilities, Links, Visual symbols and images, Options for customizing the texts, Help services and Tips, Error message alert, Interaction and feedback facilities, user interface Language, User controls, Library resources in various format, Study facilities of retrieved resources from the library) and 109 component is prepared. Then have been finalized by using the Delphi method and completed for each Library. 12 digital library service providers to blind and deaf user in the world perform the population.

Finding: Results of the study showed that the criteria of '' user interface language '' (with 97.92 %) and the criteria of '' user control'' (with 9.67 %) reached the highest and lowest scores respectively. Among the 12 digital libraries investigated worldwide, "Digital library for the blind" with respect 63.53 reached the maximum and "U.S. National Library Service for Blind" with respect 37.62 grasped the minimum levels.


Hamid Keshavarz, Fatemeh Fahimnia, Alireza Nouruzi, Mohammadreza Esmaeili Givi,
Volume 3, Issue 3 (12-2016)
Abstract

Background and Aim: The current research aims to develop a literature-dependent and expert-modified model related to credibility evaluation of web information.

Methods: Regarding the approach, mixed method would be utilized. The research method then is mixed-heuristic using both qualitative and quantitative methodologies. In the first stage of the research, meta- synthesis was used as a qualitative research method. Secondly, exploring experts’ points of view was conducted by a Delphi method to develop the conceptual model identified in the first stage.

Results: Using the seven stage mode of meta-synthesis, a model was designed in four layers including concepts, categories, codes and indicators. A set of 68 indicators were incorporated into the different layers of the model. For reliability testing of the conceptual mopdel, a Delphi study was conducted in two rounds after which the comments of the experst were included into the model. Regarding the high degree of Kendall’s coeficinet of concordance about %.65 and the agreement perecentage of the most dimensions of the model higher than %90 the conceptual model was confirmed by the sample experts.

Conclusion: The conceptual model derived from the meta-synthesis and Delphi studies is a model accepted by experts and a base for future research to design some tools for related studies. The findings showed that the credibility evaluation is a concept whith different and multiple dimensions and components suitable for users, designers and policymakers to take them into consideration in design and evaluation of web resources.


Mohsen Nowkarizi, Mr Mahdi Zeinali,
Volume 4, Issue 3 (12-2017)
Abstract

Background and Aim: The aim of this study was to measure the overlap of 4 local Persian search engines of Parsijoo, Yooz, Parseek, and Rismoun and to compare the capabilities of these engines in covering indexable web.
Methods: This was an applied and evaluative research. To collect data, a keyword-based method was used. First, the selected keywords were entered into the search engines and then a sample was extracted of the retrieved records. Finally, based on the existence or absence of these records in the search engines, the necessary data were gathered. Accordingly to analyze the data, inferential statistical methods were used.
Results: The relative overlap of the Parseek compared to that of Parsijoo and Parsijoo's one compared to Yooz was 26 percent on average and Parseek had the most recall. Rismoun had not any common records with the other investigated search engines. Three search engines (Parseekc, Parsijoo and Yooz retrieved 27 common records out of 225 recalled records; there was a significant difference between the relative overlap of the 4 search engines. Also, on average, Parseel, Parsigoo, Yooz and Rismoun covered respectively 38, 31, 26, and 6 percent of the indexable web. There was a significant difference between the coverage of the 4 search engines.
Conclusion: It seems that each search engine has a different indexing policy, and users need to search for more than one search engine to get comprehensive information about an issue. It can be predicted that by foraging in two search engines, Parseek and Parsijoo, one may access 70 percent of the indexable web.
Hashem Atapour, Fatima Fahimnia,
Volume 5, Issue 1 (6-2018)
Abstract

Background and Aim: this research investigates the impact of authors’ rank in Bibliographic networks on document-centered model of Expertise Retrieval. Its purpose is to find out what kind of authors’ ranking in bibliographic networks can improve the performance of document-centered model.  
Methodology: Current research is an experimental one. To operationalize research goals, a new test collection was developed which includes 55 queries and 96375 documents. The queries were made by Iran Knowledge and Information Science PhD students, and the documents were papers indexed in the Web of Science database under Library Science and Information Science category. The queries were submitted to the database consisting of test collection documents, and then DLH13, a known IR model, were used to retrieve documents from database. The first 100 documents retrieved by DLH13 model for each query were chosen for second stage. All people names occurred in the retrieved documents were extracted, processed, and ranked in 5 different ways based on micro metrics of Social Network Analysis. The top 10 results of every method accumulated in a pool of authors. After relevance judgment on authors’ expertise, the expert finding performance of every ranking method was measured.
Findings: Results showed that performance of authors’ ranking in citation networks hadn’t significant difference with document-centered model, whereas authors’ ranking in co-authorship networks was weaker than document-centered model, and impact it negatively.   
Conclusion: compared with author-based networks, citation-based networks are better evidence for individual’s expertise in different subject areas. 
Fatemeh Zandian, Leyla Fathi, Mohammad Hasanzadeh,
Volume 5, Issue 2 (9-2018)
Abstract

Background and Objectives: Today, websites with diverse and varied uses have revolutionized all social, scientific, educational, artistic, commercial, and other fields of thought. In the meantime, the cinema has not gone away with this technological advancement, and a large number of cinema websites have been set up to help film makers in this field. Whatever the users of a website, the main purpose and the main goals is to provide quick and easy service and to satisfy users, and this goal is achieved only with the assurance of their efficiency and performance review and performance measurement. Web sites are not possible except by evaluating them. Only this way, one can see the strengths and weaknesses of the Web sites, and they have taken steps to refine or complete their progress and development. The purpose of this study was to evaluate the cinematic websites of Iran based on the three-level pyramid model.
Methodology: Using evaluative method, 38 Iranian cinemas were evaluated using two public and specialized criteria. Using these two logos, not screening, navigation, content, availability, interaction, informational services, special services, multimedia services, and customer service have been evaluated.
Results: The evaluation results show that Iran's cinema websites are based on the three-level pyramid model, which are general criteria, at a good level, in the middle of the pyramid with appropriate specialized standards at the head of the pyramid consisting of Specialized criteria are at the right level.
Conclusion: A fully cinematic web site is considered to include at least two criteria for special services and customer service at the head of the pyramid, one in a highly professional and user-friendly manner, and at the level of the best of the same foreign websites Have your website. It seems that Iran's cinematic websites are beginning to work on this and need more activity and experience.

Dr Azam Sanatjoo, Mr Mahdi Zeynali Tazehkandi,
Volume 7, Issue 2 (12-2020)
Abstract

Purpose: There are several metrics for evaluating search engines. Though, many researchers have proposed new metrics in recent years. Familiarity with new metrics is essential. So, the purpose is to provide an analysis of important and new metrics to evaluate search engines.
Methodology: This review article critically studied the efficiency of metrics of evaluation. So, “evaluation metrics,” “evaluation measure,” “search engine evaluation,” “information retrieval system evaluation,” “relevance evaluation measure” and “relevance evaluation metrics” were investigated in “MagIran” “Sid” and Google Scholar search engines. Articles gathered to inspect and analyse existing approaches in evaluation of information retrieval systems. Descriptive-analytical approach used to review the search engine assessment metrics.
Findings: Theoretical and philosophical foundations determine research methods and techniques. There are two well-known “system-oriented” and “user-oriented” approaches to evaluating information retrieval systems. So, researchers such as Sirotkin (2013) and Bama, Ahmed, & Saravanan (2015) group the precision and recall metrics in a system-oriented approach. They also believe that Average Distance, normalized discounted cumulative gain, Rank Eff and B pref are rooted in the user-oriented approach. Nowkarizi and Zeynali Tazehkandi (2019) introduced comprehensiveness metric instead of Recall metric. They argue that their metric is rooted in a user-oriented approach, while the goal is not fully met. On the other hand, Hjørland(2010) emphasizes that we need a third approach to eliminate this dichotomy. In this regard, researchers such as Borlund, Ingwersen (1998), Borlund (2003), Thornley, Gibb (2007) have mentioned a third approach for evaluating information retrieval systems that refer to interact and compose two mentioned approaches. Incidentally, Borlund, Ingwersen(1998) proposed a Jaccard Association and Cosine Association measures to evaluate information retrieval systems. It seems that these two metrics have failed to compose the system-oriented and user-oriented approaches completely,  and need further investigation.
Conclusion: Search engines involve different components including: Crawler, Indexer, Query Processor, Retrieval Software, and Ranker. Scholars  wish to apply the most efficient search engines for retrieving required information resources. Each   metrics measures a specific component, to measure all, it is suggested to select metrics from all three mentioned groups in their search.
Mr Mahmoud Pouyanfar, Dr Mohammad Reza Kiani, Dr Mohammad Javad Hashemzadeh,
Volume 7, Issue 2 (12-2020)
Abstract

Purpose: Today, social networks and smart phones have become very popular. One of the interesting topics in the field of information science and cognition is the study of users' information behavior in mobile-based social networks. In this area, this study examines the role of psychological variables: communication Apprehension, Expression of the True Self, and Fear of Negative Evaluation in Instagram and Selfie use. The main purpose of this study was to investigate the role of communication Apprehension, Expression of the True Self, and Fear of Negative Evaluation in Instagram and Selfie use from the perspective of undergraduate students of Birjand University.
Methodology: This correlational study used 4 questionnaires "Communication Apprehension" (McCroskey, 1982), "Fear of Negative Evaluation" (Leary, 1983), " Instagram Use " (Lazebna, 2015) and "Taking a selfie" (Lazebna, 2015) (online) in a random sample of undergraduate students at the University of Birjand (357 participants).
Findings: Communication Apprehension and selfie use were significantly higher in women than in men. However,  there was no significant differences shown for  the other variables.  Instagram usage was above average and sending  and edited selfies were below average. The increase of most of the psychological variables investigated also showed the increase of use of Instagram, selfies and edited selfies. Also, with the increase of communication apprehension, the fear of  negative evaluation increased.
Conclusion: Review of the literature revealed that  there wasn’t any interest in the field of  knowledge and information science for the topic at the national level. Although, there were limited studies presented in the international arena.
Samira Daniali, Dr. Amir Hossein Seddighi,
Volume 8, Issue 2 (9-2021)
Abstract

Background: The purpose of this study is to evaluate the University of Tehran website based on information architecture indicators to inform, assess the status and quality of the website.
Methodology: The research method is applied descriptive. Checklist was used to analyze the website in terms of organization, labeling, navigation, and search systems.
Findings: The results of the checklists showed that the University of Tehran website earned 20 points out of 37 in the organization, 37 points out of 57 in the labeling, 53 points out of 78 in the navigation, and 14 points out of 46 in the search, which imply a poor status in search system, an average status in organization system, and a good status in labeling and navigation systems. According to the obtained results, the search system of the University of Tehran website can be redesigned, its organization system can be reviewed, and other mentioned systems can be improved. In general, in order to increase the efficiency of websites, it is necessary to consider the principles of information architecture in their design. Moreover, this research can be a suitable source for future website policies by identifying the strengths and weaknesses of the website.
Conclusion: Evaluating the information architecture of a website is a new field that, while important, has received less attention. This research tries to show the applicability of the method for use in similar cases by presenting a systematic evaluation in a case study for the University of Tehran website while introducing the strengths and weaknesses of this website.
 
Dr. Mohammad Moradi, Dr. Mojtaba Mazoochi,
Volume 8, Issue 4 (2-2022)
Abstract

Purpose: The purpose is to present an open government data evaluation method by considering comprehensive and complete dimensions and criteria - calculating the weight and importance of each criterion, examining the country in this area, clustering organizations and presenting a classification model to predict the situation.
Methodology: Library studies was used to extract the dimensions and criteria of evaluation. Population includes articles related to open government data evaluation criteria. Ten articles were reviewed by simple random sampling method. Multiple attribute decision making techniques was used to calculate the weight and importance of each criterion. Data mining techniques was incorporated to cluster and create a classification model.
Findings: By reviewing the articles 15 criteria of open government data evaluation including:  Data originality, license openness, up-to-datedness, data access rate, metadata completeness, number of data sets, format openness, non-discriminatory, comprehensible, number of data fields, free, no missing data, data request ability, visual and feedback, were extracted. Using AHP technique, the weights of the criteria were calculated, which after normalization, the total weight of the 15 extracted criteria was equal to one. "Data originality" with a weight of 0.165, " license openness " with a weight of 0.124 and " up-to-datedness" with a weight of 0.109 were ranked first to third among 15 evaluation criteria, respectively. Weight of evaluation criteria obtained and data extraction of 358 organizations in harmony with 15 evaluation criteria, the weight of organizations was calculated. The sum of the weights was equal to one. "East Azerbaijan Agricultural Jihad Organization" with a weight of 0.088, "Statistics Center of Iran" with a weight of 0.062 and "Geological Survey" with a weight of 0.058 were the first to third ranks among 358 organizations and government institutions, respectively, based on the combination of criteria and the weight of criteria.
Conclusion: Evaluation criteria obtained, calculating the weight and importance of each criterion, examining the current situation of government organizations and institutions in the country and the classification model created can help managers to understand the current situation and improve it and thus increase citizens' interaction with open government data as a kind of human information interaction.

Dr. Ali Naimi-Sadigh, Dr. Mohammad Rabiei, Dr. Alireza Seghatoleslami,
Volume 9, Issue 2 (9-2022)
Abstract

Objectives: The National Conference of Information Technology Managers is conceivably the most significant of its nature in the country. Chief competitive advantage to comparable ones is its observant of products in IT as an alternative to papers. The purpose is a comprehensive design for the scientific evaluation of information technology products.
Method: For the evaluation plan of the premium information technology award (FAB), three main scientific-technological, managerial-economical and cultural-social axes were studied.  At the end, the criteria and sub-criteria were interviewed using the experts' focus group method. Initially, the information technology products were classified according to their nature.  Then, the importance of criteria and sub-criteria were determined for all their features. Finally, evaluation of the products was done based on their identified importance.
Findings: The products are divided into 9 groups according to the type of customer and the product usage. Each of these 9 groups will have unique features and different sub-criteria. They receive their total weight by points given via expert judges that will be their score compared to the other products, and therefore could rank the products.
Conclusion: After receiving the products, in the first stage, they are evaluated in the internal scientific evaluation committee of the conference. In the next stage, the products receiving the highest points are for the evaluation of the presence of internal and external judges.

 
Nosrat Riahinia, Farzaneh Shadanpour, Keyvan Borna, Gholam Ali Montazer,
Volume 9, Issue 3 (10-2022)
Abstract

Purpose: This study investigates the automatic keyword extraction from the table of contents of Persian e-books in the field of science using LDA topic modeling, evaluating their similarity with the golden standard, and users' viewpoints of the model keywords.
Methodology: This is mixed text-mining research in which LDA topic modeling is used to extract keywords from the table of contents of scientific e-books. The evaluation of the used approach has been done by two methods of cosine similarity computing and qualitative evaluation by users.
Findings: Table of contents are medium-length texts with a trimmed mean of 260.02 words, about 20% of which are stop-words. The cosine similarity between the golden standard keywords and the output keywords is 0.0932 thus very low. The full agreement of users showed that the extracted keywords with the LDA topic model represent the subject field of the whole corpus, but the golden standard keywords, the keywords extracted using the LDA topic model in sub-domains of the corpus, and the keywords extracted from the whole corpus were respectively successful in subject describing of each document.
Conclusion: The keywords extracted using the LDA topic model can be used in unspecified and unknown collections to extract hidden thematic content of the whole collection, but not to accurately relate each topic to each document in large and heterogeneous themes. In collections of texts in one subject field, such as mathematics or physics, etc., with less diversity and more uniformity in terms of the words used in them, more coherent and relevant keywords are obtained, but in these cases, the control of the relevance of keywords to each document is required. In formal subject analysis procedures and processes of individual documents, this approach can be used as a keyword suggestion system for indexing and analytical workforce.
 
Dr. Amir Hossein Seddighi,
Volume 9, Issue 4 (1-2023)
Abstract

Purpose: As mission-oriented organizations, research institutes have the task of answering community questions in specialized areas, and should therefore be able to effectively present their outputs to their target users. Achieving such a goal requires the proper use of information architecture principles to properly organize the information platform in which the research institutes interact with their audiences. Therefore, reviewing and evaluating the information architecture of Research Institutes’ websites as their main communication platform with their users is of particular importance. The purpose of this study is to evaluate the Iranian Research Institute for Information Science and Technology’s website based on information architecture.
Methodology: The research method is based on content analysis and case evaluation and is done using direct observations and checklists in March 2022. In this regard, first the components of the information environment, ie the context, content, and user of the website are identified. Then, we check the information architecture subsystems of the website using checklists based on the components of the information environment. The organization system checklist contains 14 main questions, the labeling system checklist contains 32 main questions, the navigation system checklist contains 20 main questions, and finally, the search system checklist contains 41 main questions. The checklists were prepared using the library research method and approved by an expert panel. Excel software is used to collect and analyze data.
Findings: Users of the Iranian Research Institute for Information Science and Technology’s website can be categorized into four groups: researchers and students, science and technology policymakers, librarians and informants, and educational and research institutions. The main content of this website includes reports, books, articles, research projects, information systems, scientific events, training courses, laboratories, and collaborative services. The context of the website is based on service development and delivery in the areas of knowledge management, scientific and technological information management, dissemination of information science and technology, supporting science and technology policymakers, Publicizing the use of information technology, cooperating with universities and research institutes, and supporting research in the field of information science and technology. The results of the checklists indicate the score of this website for the organization system, the labeling system, the navigation system, and the search system as 67.6%, 68.4%, 65.4%, and 34.8%, respectively.
Conclusion: The status of the Iranian Research Institute for Information Science and Technology’s website is assessed as good in terms of the organization system, the labeling system, and the navigation system, and poor in terms of the search system. The use of an audience-oriented organization plan in the website organization system, the use of index labels in the form of unique entities in the website labeling system, and the use of a main navigation bar with an integrated and similar design in the website navigation system are among the strengths of the website information architecture design. On the other hand, according to the research findings, to improve the search system, it is necessary to pay attention to features such as “correcting spelling errors in the input query”, “highlighting the input query in the retrieved results”, “adding logical operators to the search system”, “searching metadata”, “sorting results in alphabetical and chronological order”, and “adding search filters such as subject and year”.
 


Page 1 from 1     

© 2024 CC BY-NC 4.0 | Human Information Interaction

Designed & Developed by : Yektaweb