Group items tagged

"07/2012; In proceeding of: The 11th International Conference on Software Engineering Research and Practice (SERP 2012), At Las Vegas, USA ABSTRACT Usability is considered a relevant quality factor in video games. However, usability evaluations are usually performed too late in the game development lifecycle. We present a usability evaluation strategy that can be used in early stages of model-driven video game development approaches. The usability evaluation is based on a Video Game Usability Model, which extends the usability characteristic of the ISO/IEC 25010 (SQuaRE) standard by incorporating measurable attributes and measures related to the video game domain. The traceability established between the models that are produced in a modeldriven development process and the corresponding source code allows performing usability evaluations on these models, facilitating the early detection/correction of usability problems that may appear in the final video game application. To show the feasibility of this approach, we have performed an early usability evaluation of a video game for the XBOX360 platform."

"The UT^2 game bot, created by computer scientists Jacob Schru, Igor Karpov and Risto Miikkulainen, won the Humanlike Bot Competition at the IEEE World Congress on Computational Intelligence (WCCI 2012). "The idea of the competition is to evaluate how we can make game bots, non-player characters (NPCs) controlled by AI algorithms, appear as human as possible," explains Miikkulainen, professor of computer science in the College of Natural Sciences. "It is generally recognized that NPCs are relatively weak in most video games: their behavior is predictable and mechanical, and they often make mistakes that human players would be unlikely to make. Players often enjoy playing against other humans, because it provides a more interesting game experience. The goal of the competition is to promote more research in human-like bots, as well as evaluate how well we are currently doing in this area."

"a casual game that addresses childhood cancer: Besides mere entertainment, a health game that focuses on cancer may serve as a clinical tool in order to teach children about the particularities of the disease and initiate discussion among cancer patients, their parents and medical staff. In this context, the results of an empirical study revealed a generally high acceptance of the health game among young patients, while parents and medical staff highlighted the educational potential of health games addressing cancer. Additionally, we discuss the challenges of evaluating digital games in a hospital setting which were revealed during the evaluation phase."

Abstract: "Video games that customize to a player's experience level and abilities have the potential to allow a broader range of players to become engaged and maintain interest as they progress in experience level. A game that uniquely customizes the player's experience could attract additional demographics to gaming, which will result in a distinct edge in marketability and potential revenue. This thesis examines a subsection of adaptive gaming systems from the perspective of identifying game factors that alter the level of difficulty. Our focus is to provide a solution useful to both research and commercial gaming communities by developing a system that simulates results offline yet can be integrated into online play. While online performance is the main goal of an adaptive system, the offline simulation provides several benefits. Offline simulation allows the elimination of insignificant factors from inclusion in the training and evolution phase of machine learning algorithms. In addition it provides commercial games with a useful tool or method for performing game balancing and level tuning. To test our approach we designed a test-bed version of the game Pac-Man. The experimental testbed alters environment variables to evaluate their effect on a set of selected response variables. Observing the results of several response variables provides the potential to represent multiple player states, though our focus is on controlling the difficulty for a player. The testbed will simulate the actions of both Pac-Man and the ghosts over a variety of different settings and strategies. The evaluation of a factor's significance and its effect size are calculated using a factorial analysis approach. This method allows the identification of factors relevant to both individual strategies, and the set of all player strategies. Finally, as a proof of concept for both the online and adaptation prospects of this method, we developed a prototype adaptive system. Utilizing the releva

Abstract: "In this project, the following research question is set forth: is it possible to create fair maps for a video game using multi objective evolution algorithms? A description of the video game used for this project, Civilization V, is provided as well as an overview of other map generation methods, and research being done in the field of procedural content generation. A definition for what is fair is made and expressed through functions, that evaluate maps for the video game Civilization V. These evaluation functions express five distinct perspectives on how fair maps are perceived. The fitness functions are designed to conflict as little as possible with each other. A method is defined as to how this theory is applied in practice to generate maps for Civilization V. The evaluation functions are applied on maps from the game's map generation method, and compared to maps that have been evolved with the method provided by this project."

Abstract: "In this study, we device a digital game, which possessed scientific and fun, base on the conception of insects (DGBI), then can use it to test elementary school student's conception about insect. The DGBI materials creating pattern use as the ADDIE model. First step is to analyze the DGBI materials. We analyze student's alternative conceptions of insect and what the teaching staff needs to teach in the section of insect, and then we develop three teaching units, namely the ―Bugs Adventure‖, ―Legs and Wings "and" Mouthparts and feeding habits‖. Second, design the DGBI. Making DGBI has a clear teaching aim, multi-learning strategy like conception puzzle, computer simulation and conception mapping etc, an artistic and convenient operating media interface and a learning content that is easy to understand by the words and video in the DGBI materials. Third, develop the DGBI. Developing DGBI includes making animation component and composing animation component, these animation components makes 94.4% of students prefer to use DGBI materials to learn the conceptions of insect, especially the constructional detail magnify function and interactive game design in the teaching materials increase the student's learning interest. Forth, implement DGBI. We invite Two national college professors and four senior science teachers to use DGBI, and then we interview them to collect the testing amendments, and corrected it.Fifth, evaluate DGBI. We use quasi-experiment design and questionnaire survey to evaluate DGBI. In the quasi-experiment design, we select 111 students for four classes in an elementary school in New Taipei City and ask them to use DGBI, and then we tested them by the ―Insects Conceptions test‖. We found that after using the DGBI materials, the student's post-test scores (13.64) is higher than the pre-test scores (7.55), and there are significant differences (t = 16.47,p = .00)and helps the student to establish the correct concept of insect

Abstract: "following paper presents an experimental study. In the study a course for Basic Life Support training has been evaluated and two game design patterns have been applied to the course. The hypotheses evaluated in this paper relate to game design patterns that have been used for learning functions, expected to enhance the learning outcome and user experience. An experimental design has been carried out in order to get insight about effects of individual and combined game patterns in a Basic Life Support course. Based on the according educational objectives, the effects of two different game design patterns relevant for learning (a timer pattern and a score pattern) have been evaluated. This game was prototypically developed targeting the application on the healthcare domain (basic life support). The results show a significant interaction effect of the two patterns on the learning gain, as well as a strong covariate influence of the learners' age."

"In this thesis we present the design and evaluation of a learning game based on the concept of 'stealth learning' and the theory of constructivism, which provides an early introduction to basic programming concepts and procedural literacy to children from 10 years upwards, attempting to provide the highest possible degree of immersion. The evaluation involves a number of tests verifying usability, immersion and motivation, and an attempt to test the transferability of the ingame acquired knowledge to reading pseudocode, the results of which, triggered further reflection on the possibility of adding new layers of complexity and embedding evaluation of learning within the game experience."

Abstract: "This paper describes the design and evaluation of Zoo U, a novel computer game to assess children's social skills development. Zoo U is an innovative product that combines theory-driven content and customized game mechanics. The game-like play creates the opportunity for stealth assessment, in which dynamic evidence of social skills is collected in real time and players' choices during gameplay provide the needed data. To ensure the development of an engaging and valid game, we utilized an iterative datadriven validation process in which the game was created, tested, revised based on student performance and feedback, and retested until game play was statistically matched to independent ratings of social skills. We first investigated whether the data collected through extensive logging of student actions provided information that could be used to improve the assessment. We found that detailed game logs of socially relevant player behavior combined with external measures of player social skills provided an efficient vector to incrementally improve the accuracy of the embedded assessments. Next, we investigated whether the game performance correlated with teachers' assessments of students' social skills competencies. An evaluation of the final game showed (a) significant correlations between in-game social skills assessments and independently obtained standard psychological assessments of the same students and (b) high levels of engagement and likeability for students. These findings support the use of the interactive and engaging computer game format for the stealth assessment of children's social skills. The created innovative design methodologies should prove useful in the design and improvement of computer games in education."

Abstract: "It has been well-noted that contemporary digital games tend to design for a relatively high skill threshold engineered to appease a well-entrenched and digitally literate audience (Hayes, 2005). Such design practices, however, serve to disenfranchise new and novice players wanting to learn to play. This novice-expert divide is a significant barrier to entry for individuals wanting to play digital games, and given that digital games are seeing increased use in pedagogical contexts (Akilli, 2007; Becker, 2007; Nieborg, 2011; Shelton, Satwicz, & Caswell, 2011; Ulicsak, 2010), such skill-based barriers further complicate the seamless incorporation of digital games into the classroom. In an effort to explore how we might bridge the gap between new and weathered players, I created three tutorials for World of Warcraft (2004) in an attempt to improve the existing tutorials for newer entrants to the game. These new tutorials offered different modalities of instruction, as well as instructional strategies in assisting newer players. Tutorials were designed using the Structured Sound Functions (SSF) model of instructional design, following the Attentional Control Theory of Multimedia Learning (ACTML). The tutorials were then analyzed for their effects on play outcomes, player engagement, and player motivations using the Dick and Carey (2011) three-stage model of formative evaluation. This work thus makes two important contributions. First, this research conducts a much-needed in-depth study of game tutorials, which is an area yet to be well-charted in the disciplines of either education or games studies. Secondly, by analyzing the results of the formative evaluation, I conclude that players react favorably to a faded or "just-in-time" instructional strategy-an approach to player scaffolding which showed significantly increased motivation for play, engagement, and play mastery among novice participants. Implications for game design and future research are disc

Abstract :"We present an attempt at exploring the search space of weapons in team-based multiplayer First-Person Shooters (FPS). At the foundation of the experiment is Team Block- head Wars (TBHW), a game that we developed for the pur- poses of this project. TBHW allows human players to enjoy classic multiplayer FPS gameplay and uses a genetic algo- rithm to continuously generate new weapons. A weapon's genome consists of ten real-valued parameters, which to- gether form a vast search space that includes common FPS weapon tropes. The evaluation function scores weapons on the basis of their use by players. The game also generates 3D meshes to visually represent the generated weapons for easy player recognition. While TBHW is work in progress, preliminary results are encouraging."

Abstract: "Serious games have proven to be a useful instrument to engage learners and increase motivation. Nevertheless, a broadly accepted, practical instructional design approach to serious games does not exist. In this paper, we introduce the use of an instructional design model that has not been applied to serious games yet, and has some advantages compared to other design approaches. We present the case of mechanics mechatronics education to illustrate the close match with timing and role of knowledge and information that the instructional design model prescribes and how this has been translated to a rigidly structured game design. The structured approach answers the learning needs of applicable knowledge within the target group. It combines advantages of simulations with strengths of entertainment games to foster learner's motivation in the best possible way. A prototype of the game will be evaluated along a well-respected evaluation method within an advanced test setting including test and control group."

Evaluation involving three NASA-based multiplayer game partnerships

From the abstract: Recent studies show that the second generation of migrants is not adequately integrated into mainstream society but tends to segregate into secluded segments. 'Internet Use and Friendship Structures of young migrants in Vienna: a Question of Diversity within Social Networks and Online Social Games'1 is a transdisciplinary2 research project with the objective to create a serious music-based online social game, which firstly is intended to be a positive impact game with the purpose of furthering integration and encouraging the manifestation of meaningful multiethnic relations. Secondly, the game shall make social interaction observable for evaluation. This paper gives an overview of which methodological approaches can be combined in the phases of the game's design process and shows how the mutual embedding of game design researchers and social scientists works in this context."

"effect of game reviews on player experience and perceptions of quality. We show that negative reviews cause a significant effect on how players perceive their in-game experience, and that this effect is a post-play cognitive rationalization of the play experience with the previously-read review text. To address this effect we designed and deployed a new heuristic evaluation technique that specifically uses game reviews to create a fine-grained prioritized list of usability problems based on the frequency, impact, and persistence of each problem. By using our technique we are able to address the most common usability problems identified by game reviews, thus reducing the overall level of negativity found within the review text. Our approach helps to control and eliminate the snowballing effect that can be produced by players reading reviews and subsequently posting their own reviews, and thus improve the commercial success of a game."

From the abstract: "This paper presents a framework for evaluating and designing game design patterns commonly called as "achievements". The results are based on empirical studies of a variety of popular achievement systems. The results, along with the framework for analyzing and designing achievements, present two definitions of game achievements. From the perspective of the achievement system, an achievement appears as a challenge consisting of a signifying element, rewards and completion logics whose fulfilment conditions are defined through events in other systems (usually games). From the perspective of a single game, an achievement appears as an optional challenge provided by a meta-game that is independent of a single game session and yields possible reward(s)." Presented at DiGRA 2011 Conference: Think Design Play.

Abstract: "Digitalization has given rise to new opportunities for small and medium-sized video game development studios. No longer bound by physical products and creative restrains, the de-veloper has been empowered with independency. This qualitative study is aimed to under-stand how a development studio develops their business model and how underlying strate-gy is formulated. Additionally we evaluate the degree of innovativeness of the business model in terms of radical and incremental innovation according to Damanpour (1991). To achieve this we present a comprehensive literature review as to gain a more theoretical un-derstanding of industry mechanics and to be able to comprehend reasoning behind existing business models. We structure the dynamics of the business model by analyzing nine busi-ness model aspects as suggested by Osterwalder, Pigneur and Clark (2010). Following our theoretical framework we gain practical input from four separate case studies. An interpret-ative research method is used to gain better understanding of reasoning and choices made. We interpret our findings following a narrative approach which shows that the digitaliza-tion has preluded a paradigm shift in the sense that development studios have started to adopt activities otherwise performed by key partners. As barriers dissipate small and me-dium-sized development studios try to make sense of the current industry, but struggle in doing so. Having to reinvent themselves we conclude that a focus towards creating thicker customer relationships is considered and the idea of seeing games as a service is acknowl-edged to depict the future of the industry. The conclusions of this study contribute to both academic science and industry practice."

"ABSTRACT The art form of the video game has a very idiosyncratic reliance on the process and practice of its designers. We work with creative and computational problems that form a web of deep complexity. And yet, as I have noticed in my professional practice as a game designer, we do not use tools to support our design process. For more than a decade, designers and researchers have argued for the development and use of both conceptual and concrete tools. To this end, formal and semi-formal game design models have been proposed and, more recently, experimental software-based tools have been developed by the research community. To date, however, none of these tools or models have been adopted into mainstream practice within the game design community. In this paper I argue that it is difficult, if not methodologically flawed, to assess the work in the field of game design support without more qualitative data on how such tools fare in actual game design practice. Evaluation research would be an essential contribution towards answering the question of whether - and if so, how - these experimental formal models and tools can support and improve the game design process."

"We propose a course design that ts a practical game development project into a regular game design lecture course. As this approach requires a consistent structure, our concept proposes an adaption of Scrum that is based on the game development life-cycle: ABC-Sprints consist of three Sprints to iteratively create Alpha, Beta and Completed versions of a game. We present a detailed walkthrough of the course and give results of a formal evaluation. These indicate that ABC-Sprints help students to manage their workload and to increase productivity over time. Consequently, three teams each presented a game at the end of the course that technically exceeded typical outcomes of game projects without lectures. We hence encourage to apply ABC-Sprints to other curricula and provide a set of recommendations."

Abstract: "This paper introduces Rank-based Interactive Evo- lution (RIE) which is an alternative to interactive evolution driven by computational models of user preferences to generate personalized content. In RIE, the computational models are adapted to the preferences of users which, in turn, are used as fitness functions for the optimization of the generated content. The preference models are built via ranking-based preference learning, while the content is generated via evolutionary search. The proposed method is evaluated on the creation of strategy game maps, and its performance is tested using artificial agents. Results suggest that RIE is both faster and more robust than standard interactive evolution and outperforms other state-of- the-art interactive evolution approaches"