Logically Characterizing Adaptive Educational Hypermedia Systems

Nicola Henze and Wolfgang Nejdl
University of Hannover
ISI - Knowledge Based Systems
Appelstr. 4 $\cdot$ D-30167 Hannover
http://www.kbs.uni-hannover.de/~{henze,nejdl}
{henze,nejdl}@kbs.uni-hannover.de

Abstract

Currently, adaptive educational hypermedia systems (AEHS) are described with nonuniform methods, depending on the specific view on the system, the application, or other parameters. There is no common language for expressing functionality of AEHS, hence these systems are difficult to compare and analyze. In this paper we investigate how a logical description can be employed to characterize adaptive educational hypermedia. We propose a definition of AEHS based on first-order logic, characterize some AEHS due to this formalism, and discuss the applicability of this approach.

1. Motivation

This paper aims at developing a logical characterization of adaptive educational hypermedia and web-based systems (AEHS). AEHS have been developed and tested in various disciplines and have proven their usefulness for improved and goal-oriented learning and teaching. However, these systems normally come along as stand-alone systems - proprietary solutions have been investigated, tested and improved to fulfill specific, often domain-dependent requirements. So far, there has been no attempt to define a common language for describing AEHS. We claim that such a shared language will support the analysis and comparison of AEHS, and, in addition, a comprehensible description of AEHS will encourage an extended use of adaptive functionalities in e-Learning. This is especially important with respect to the Semantic Web [13], and, associated, the Adaptive Web [4] which knows like a personal agent the specific requirements of a user, takes goals, preferences or the actual context into account in order to optimize the access to electronic information.

Bringing personalization to the Web requires an analysis of existing adaptive systems, and of course this holds for the special case of e-learning and education. In this paper, we propose a component-based definition of adaptive educational hypermedia systems. A functionality-oriented definition of adaptive hypermedia has been given by Brusilovsky, 1996 [1].:

Definition 1 (Adaptive hypermedia system)   "By adaptive hypermedia systems we mean all hypertext and hypermedia systems which reflect some features of the user in the user model and apply this model to adapt various visible aspects of the system to the user."

The component-based definition proposed in this paper is motivated by Reiter`s theory of diagnosis [10] which settles on characterizing systems, observations, and diagnosis in first-order logic (FOL). We decompose adaptive educational hypermedia systems into basic components, according to their different roles in the system: Each adaptive (educational) hypermedia system is obviously a hypermedia system, therefor it makes assumptions about documents and their relations in a document space. It uses a user model to model various characteristics of individual users or user groups. During runtime, it collects observations about the user's interactions. Based on the organization of the underlying document space, the information from user model and from the system's observation, adaptive functionality is provided.

This paper is organized as follows: In the next section we give a first description of the components of an AEHS and explain their roles and functionality with examples. We then give a definition of AEHS based on FOL. Due to this formalization, an artificial AEHS with few adaptive functionalities is described in section 3, and four examples of existing AEHS. Due to space constraints, we can not present the complete descriptions in this paper but will only exemplary show the applicability of our definition. The detailed descriptions can be found in a Technical Report [6]. A synopsis of the results is given in section 4. We conclude with a discussion about the results of our logic-based characterization of AEHS.

2. Towards a Logic-Based Definition of AEHS

In this section we will first give a description of the components in AEHS and their roles. Afterwards we will give a formal definition of adaptive educational hypermedia systems based on first-order logic. We claim that an Adaptive Educational Hypermedia System (AEHS) is a Quadruple
 
(DOCS, UM, OBS, AC)
with
DOCS:
Document Space belonging to the hypermedia system in question as well as information associated to this document space. This associated information might be annotations (e.g. metadata attributes, usage attributes, etc.), domain graphs that model the document structure (e.g. a part-of structure between documents, comparable to a chapter - section - subsection - hierarchy), or knowledge graphs that describe the knowledge contained in the document collections (e.g. domain ontologies).
UM:
User Model: stores, describes and infers information, knowledge, preferences etc. about an individual user (might share some models with DOCS). The observations OBS are used for updating the user model UM. Examples of user models are overlay models where the user's state of knowledge is described as a subset of an expert's knowledge of the domain. Student's lack of knowledge is derived by comparing it to the expert's knowledge. A stereotype user modeling approach classifies users into stereotypes: Users belonging to a certain class are assumed to have the same characteristics.
OBS:
Observations about user interactions with the AEHS. Here, everything about the runtime behavior of the system concerning user interactions is contained. Examples are observations whether a user has visited a document, or visited document for some amount of time, etc. Other examples are rules for compiling e.g. quizzes for testing a user's knowledge on some subject, etc.
AC:
Adaptation Component: rules for adaptive functionality (e.g. whether to suggest a document for learning, or for generating reasonable learning paths, etc.), rules for adaptive treatment (e.g. sorting the links leading to further documents according to their usefulness for a particular user, etc. ), etc.

To formalize this above definition let's gain a deeper insight into these components:

2.1 DOCS: The Document Space

The objects of discourse in the document space are the documents, and, if applicable, the knowledge topics. Their equivalent in the logical description are the atoms: the document identifier (doc_id) or topic identifier (topic_id) respectively.

Domain graphs (or knowledge graphs) are expressed as predicates that state the relations between the documents (or topics). For formalizing the part-of domain graph mentioned as an example in the previous section, we define predicates like


part_of(doc_id$_1$, doc_id$_2$) .
Another example is the prerequisite relation between documents stating which documents need to be learned before a certain document can be studied:
preq(doc_id$_1$, doc_id$_2$).
Some AEHS use a separate knowledge graph to express relations about knowledge topics. These topics normally do not correspond one-to-one to the documents. If a separate knowledge graph exists, this graph will be expressed by several predicates as well. E.g., a taxonomy on topics will be expressed by predicates like
is_a(topic_id$_1$, topic_id$_2$) .
A further example are learning dependencies modeled on topics:
is_dependent(topic_id$_1$, topic_id$_2$) .

2.2 UM: The User Model

The user model expresses, derives and draws conclusions about the characteristics of users. This might be done by modeling each individual user or by modeling typical groups that represent users with similar behavior, requirements, etc. (so called stereotypes). Objects of discourse in the user model are the user which are logically expressed by atoms, the user identifier (user_id), and the various characteristics which can be assigned to this user in this AEHS. The characteristics of a user are expressed by predicates:

has_property(user_id, characteristic_x ) or
has_property(user_id, characteristic_x, value), etc.
A prominent characteristic in AEHS is the knowledge a user has on documents (or knowledge topics). The first of the following examples uses a binary value for the knowledge, the second example allows different grades of knowledge:
has_property(doc_id, user_id, know) or
has_property(doc_id, user_id, know, value), etc.
The characteristic "knowledge" is very prominent for educational adaptive hypermedia systems, so we can abbreviate the above predicates by:
knows(doc_id, user_id) or
knows(doc_id, user_id, value), etc.

2.3 OBS: The Observations

Observations are the result of monitoring a user's interactions with the AEHS at runtime. Therefor, the objects for modeling observations are the users (as in the case of the UM) and the observations.

Typical observations in AEHS are whether a user has studied some document. The corresponding predicate is

obs(doc_id, user_id, visited) or
obs(doc_id, user_id, visited, value), etc.
If the document is a test and the user has worked on this test by answering the corresponding questions, predicates like
obs(doc_id, user_id, worked_on) or
obs(doc_id, user_id, worked_on, value), etc.,
are used.

2.4 AC: The Adaptation Component

Finally, the adaptation component contains rules for describing the adaptive functionality of the system. An example for adaptive functionality is to decide whether a user has sufficient knowledge to study a document (recommended for learning). This functionality belongs to the group of functionalities which determine the "learning state" of a document. A simple rule might be to recommend a document for learning if all documents that are "prerequisites", e.g. that need to be studied before this document can be learned, have been visited:

$\forall$user_id $\forall$doc_id$_1$
$\forall$doc_id$_2$ preq(doc_id$_1$,doc_id$_2$$\Longrightarrow $ obs(doc_id$_2$, user_id, visited) )
$\Longrightarrow $ learning_state(doc_id$_1$, user_id, recommended_for_reading).
The adaptive treatment is a set of rules describing the runtime behavior of the system. An often used adaptive treatment is the traffic light metaphor [1] to annotate links: Icons with different colors are used to show whether a document corresponding to a link is recommended for reading (green color), might be too difficult to study (yellow color), or is not recommended for reading (red color). The rule defining this adaptive treatment "document annotation" is:
$\forall$doc_id $\forall$user_id
learning_state(doc_id, user_id, recommended_for_learning)
$\Longrightarrow $document_annotation(doc_id, user_id, green_icon).

2.5 Definition of Adaptive Educational Hypermedia Systems

In this section, we will give a logic-based definition for AEHS. We have chosen first order logic (FOL) as it allows us to provide an abstract, generalized formalization. The notation chosen in this paper refers to [11]. The aim of this logic-based definition is to accentuate the main characteristics and aspects of adaptive educational hypermedia.

Definition 2 (Adaptive Educational Hypermedia System (AEHS))   An Adaptive Educational Hypermedia System (AEHS) is a Quadruple

(DOCS, UM, OBS, AC)
with
DOCS:
Document Space: A finite set of first order logic (FOL) sentences with atoms for describing documents (and knowledge topics), and predicates for defining relations between these atoms.
UM:
User Model: A finite set of FOL sentences with atoms for describing individual users (user groups), and user characteristics, as well as predicates and rules for expressing whether a characteristic applies to a user.
OBS:
Observations: A finite set of FOL sentences with atoms for describing observations and predicates for relating users, documents / topics, and observations.
AC:
Adaptation Component: A finite set of FOL sentences with rules for describing adaptive functionality.
The components "document space" and "observations" describe basic data (DOCS) and run-time data (OBS). User model and adaptation component process this data, e.g. for estimating a user's preferences (UM), or for deciding about beneficial adaptive treatments for a user (AC).

3. Examples

This section provides two examples: The first example is a prototypical (artificial) AEHS whose purpose is to illustrate the applicability of the above proposed framework. The second example shows excerpts of the logical description of an existing AEHS: the NetCoach system [14]. Due to space constraints, we can not provide the full description of NetCoach in this paper. We have characterized three further AEHS, the Interbook system [3], the ELM-ART II system [15], and the KBS hyperbook system [7]. The complete logic-based description of these systems can be found in a technical report [6]. In this paper, we only summarize the results of the descriptions (section 4).

3.1 A very simple AEHS

We describe a simple AEHS, called Simple with the following functionality: Simple can annotate hypertext-links to documents by using the traffic light metaphor with two colors: red for non recommended, green for recommended pages.

3.1.1 Simple: Document Space

A set of $n$ atoms ($n$ corresponds to the number of documents in the document space) which name the documents:
D$_1$, D$_2$$\dots$, D$_n$.
Plus a finite set of predicates stating the documents that need to be studied before a document can be learned, e.g. D$_j$ is a prerequisite for D$_i$:
preq(D$_i$, D$_j$) for certain D$_i$$\neq$ D$_j$.
(N.B.: This AEHS does not employ an additional knowledge model).

3.1.2 Simple: User Model

A set of m axioms, one for each individual user:
U$_1$, U$_2$$\dots$, U$_m$.

3.1.3 Simple: Observations

One atom for the observation whether a document has been visited:
Visited.
And a set of predicates
obs(D$_i$, U$_j$, Visited) for certain D$_i$, U$_j$.

3.1.4 Simple: Adaptation Component

One atom for describing the values of the adaptive functionality "learning_state":
Recommended_for_reading,
and two atoms representing values of the adaptive treatment:
Green_Icon, Red_Icon.
Rules for describing the learning state of a document
$\forall$U$_i$$\forall$D$_j$
$\forall$D$_k$preq(D$_j$, D$_k$$\Longrightarrow $obs(D$_k$, U$_i$, Visited) )
$\Longrightarrow $learning_state(D$_j$,U$_i$, Recommended_for_reading).
And rules for describing the adaptive link annotation with traffic lights:
$\forall$U$_i$$\forall$D$_j$
learning_state(D$_j$, U$_i$, Recommended_for_reading)
$\Longrightarrow $document_annotation(D$_j$, U$_i$, Green_Icon),
$\forall$U$_i$$\forall$D$_j$
$\neg$ learning_state(D$_j$, U$_i$, Recommended_for_reading)
$\Longrightarrow $document_annotation(D$_j$, U$_i$, Red_Icon).

3.2 NetCoach

NetCoach [14] is the successor of ELM-ART II and provides a framework for building adaptive educational hypermedia systems. NetCoach uses a knowledge base which consists of concepts. Due to space constraints, we can only describe a part of NetCoach, the complete description can be seen in a technical report ([6]).

3.2.1 NetCoach: Document Space

The document space consists of documents, test-groups and test-items.
D$_1$$\dots$, D$_n$, TG$_1$$\dots$, TG$_n$, TI$_1$,$\dots$, TI$_n$.
Relation between documents are e.g.:
preq(D$_i$, D$_j$) for certain D$_i$$\neq$ D$_j$.
infer(D$_i$, D$_j$) for certain D$_i$$\neq$ D$_j$.
part_of(D$_i$, D$_j$) for certain D$_i$$\neq$ D$_j$.
succ(D$_i$, D$_j$) for certain D$_i$and one D$_j$$\neq$ D$_i$.
Further, NetCoach assigns certain test-items or test-groups to a document (see [6]).

3.2.2 NetCoach: Observations

NetCoach takes the following observations about the interactions of a user U$_i$ with the system into account:
obs(D$_j$,U$_i$, Visited) for certain D$_j$, U$_i$
obs(TI$_k$, U$_i$, Worked_testitem) for certain TI$_k$, U$_i$,
obs(TI$_k$, U$_i$, Solved_testitem) for certain TI$_k$, U$_i$, and
obs(D$_j$, U$_i$, Marked) for certain D$_j$, U$_i$.

3.2.3 NetCoach: User Model

Among others, NetCoach derives whether a document D$_j$has been learned by a user U$_i$. A document has been learned, if it is either tested, inferred from other learned documents, or marked by the user. If there are no test items assigned to the document D$_j$or the tests are treated as voluntary exercises (i.e. criterion(D$_j$, Value) for Value=0), then D$_j$is assumed to be learned if it has been visited, or it can be inferred from other learned concepts, or marked by the user (for details, e.g. how rules like p_obs(D$_j$, U$_i$, Tested) are derived, compare [6]):
$\forall$D$_j$$\forall$U$_i$
p_obs(D$_j$, U$_i$, Tested)
$\vee$ (criterion(D$_j$,0) $\wedge$ ( obs(D$_j$, U$_i$, Visited) $\vee$ p_obs(D$_j$, U$_i$, Inferred_Known)
$\vee$ obs(D$_j$, U$_i$, Marked) )
$\Longrightarrow $p_obs(D$_j$, U$_i$, Learned).

3.2.4 NetCoach: Adaptation Component

NetCoach provides adaptive link annotation. E.g a link to a document D$_j$is marked with a green ball (a sign that this document is recommended for reading) for a user U$_i$, if all prerequisites of this page haven been learned by this user:
$\forall$D$_j$$\forall$U$_i$
$\forall$D$_k$preq(D$_j$,D$_k$$\Longrightarrow $p_obs(D$_k$,U$_i$,Learned) )
$\Longrightarrow $document_annotation(D$_j$, U$_i$, Green_Ball)
It supports learning goals (which are defined as a set of documents) and provides learning sequences to reach these learning goals (see [6]).

4. Synopsis of some logically characterized AEHS

This chapter provides synoptical tables of the logic-based characterization of the adaptive educational hypermedia systems NetCoach [14], Interbook [3], ELM-ART II [15], and KBS hyperbook [7] (the complete characterizations can be found in [6]). The atoms used in the four systems in the components DOCS, UM, OBS, and AC are summarized in table 1. Table 2 shows the used predicates. An overview on the rules is given in table 3.

 

Table 1: Atoms used in NetCoach, ELM-ART II, Interbook and KBS Hyperbook.
System  DOCS UM  OBS 
NetCoach  D$_1$$\dots$, D$_n$ U$_1$$\dots$, U$_m$, Learned,  Visited, 

TG$_1$$\dots$, TG$_k$ Inferred_Known, Tested.  Solved_Testitem, 

TI$_1$$\dots$, TI$_\ell$
Marked.
ELM-ART II  D$_1$$\dots$, D$_n$ U$_1$$\dots$, U$_m$, Tested,  Visited,

TI$_1$$\dots$, TI$_\ell$ Inferred_known.  Solved_Testitem.
InterBook  D$_1$$\dots$, D$_n$ U$_1$$\dots$, U$_m$, Learned,  Visited, 

TI$_1$$\dots$, TI$_\ell$ Beginner, Intermediate,  Solved. 

C$_1$$\dots$, C$_s$ Expert, No_knowledge. 
KBS Hyperbook  D$_1$, ...D$_n$ U$_1$$\dots$, U$_m$, Learned,  Marked, 

C$_1$$\dots$, C$_s$ Known, Well_known,  Expert, 


Excellently_known, Partly_known,  Advanced, 


Not_known, Child_known,  Beginner, 


Parent_known.  Novice.
System  AC-Adaptive Link Annotation  AC - Others 
NetCoach  Green_Ball, Red_Ball, Yellow_Ball, Orange_Ball. 
ELM-Art II  Green_Ball, Red_Ball, Yellow_Ball, Orange_Ball. 
Interbook  Small_Checkmark, Normal_Checkmark, Big_Checkmark, 

Green_Ball, White_Ball, Red_Ball. 
KBS Hyperbook  Green_Ball, White_Ball, Red_Ball. 



Table 2: Predicates used in NetCoach, ELM-ART II, Interbook and KBS Hyperbook.
System  DOCS 
NetCoach preq(D$_i$, D$_j$) (prerequisite knowledge) 

infer(D$_i$, D$_j$) (documents inferred to be learned by studying D$_i$)

succ(D$_i$, D$_j$) (reading order) 

part_of(D$_i$, D$_j$) (chapter structure) 

terminal_flag(D$_i$) (whether a document has no further sub-documents) 

criterion(D$_i$, Value) (defines number of testitems 

$\quad$ necessary for mastering D$_i$

test_assignment(D$_i$, X), X $\in$ {Testgroup, Testitem}, 

$\quad$ (relates documents with testgroups and testitems) 
ELM-ART II  preq(D$_i$,D$_j$) (prerequisite knowledge) 

out(D$_i$, D$_j$) (documents inferred to be learned by studying D$_i$

related(D$_i$, D$_j$) (author-defined relation between documents) 

successor(D$_i$, D$_j$) (reading order) 

part_of(D$_i$, D$_j$) (chapter structure) 

terminal_flag(D$_i$) (whether a document has no further sub-documents) 

test_assignment(D$_i$, X), X $\in$ {Testslot, Testitem} 

$\quad$ (relates documents with testslots and testitems) 
InterBook  preq(D$_i$, C$_j$) (prerequisite knowledge)

out(D$_i$, C$_j$) (concepts inferred to be learned by studying D$_i$

succ(D$_i$, D$_j$) (reading order) 

terminal_flag(D$_i$) (whether a document has no further sub-documents)

part_of(D$_i$, D$_j$) (chapter structure) 
KBS Hyperbook  keyword(D$_i$, C$_j$) assigns some concepts each document 

depends(C$_i$, C$_j$) learning dependencies between concepts 

role(D$_i$, X), X $\in$ {Course, Goal, Lecture, Example, etc.}

$\quad$ role of the document D$_i$

role(C$_i$, X), X $\in$ {Introduction, Concept} 

$\quad$ role of the concept C$_i$
System UM  OBS  AC 
NetCoach  obs(D$_i$, U$_j$, X), X $\in$ {Visited, Solved_Testitem, Marked} 
ELM-ART II  obs(D$_i$, U$_j$, X), X $\in${Visited, Solved_Testitem} 
InterBook  obs(D$_i$, U$_j$, X), X $\in$ {Visited, Solved} 
KBS Hyperbook  obs(C$_i$, U$_j$, Marked, Value), 


$\quad$ Value $\in$ {Expert, Advanced, Beginner, Novice} 

Table 3: Rules used in NetCoach, ELM-ART II, Interbook and KBS Hyperbook.
System  DOCS  UM  OBS
NetCoach  Rules to infer p_obs(D$_i$, U$_j$, X), X $\in$


$\quad$ {Inferred_Known, Learned, Tested} 
ELM-ART II  Rules to infer p_obs(D$_i$, U$_j$, X), X $\in$


$\quad$ {Inferred_Known, Tested} 
InterBook Rules to infer p_obs(C$_i$, U$_j$, Learned, X), X $\in$


$\quad$ {Expert, Intermediate, Beginner, No_knowledge}. 
KBS Hyperbook  Rules to infer p_obs(C$_i$, U$_j$, Learned, X), X $\in$


$\quad$ {Known, Well_known, Excellently_known, Partly_known, 


$\quad$ Not_known, Child_known, Parent_known}. 




System  AC - Adaptive Link Annotation 
NetCoach  Rules to infer document_annotation(D$_i$, U$_j$, X), 

$\quad$$\in$ {Green_Ball, Red_Ball, Yellow_Ball, Orange_Ball}. 
ELM-ART II  Rules to infer document_annotation(D$_i$, U$_j$, X), 

$\quad$$\in$ {Green_Ball, Red_Ball, Yellow_Ball, Orange_Ball}. 
InterBook  Rules to infer document_annotation(D$_i$, U$_j$, X), 

$\quad$$\in$ {Green_Ball, White_Ball, Red_Ball, 

$\quad$ Small_Checkmark, Normal_Checkmark, Big_Checkmark}. 
KBS Hyperbook  Rules to infer document_annotation(D$_i$, U$_j$, X), 

$\quad$$\in$ {Green_Ball, White_Ball, Red_Ball}. 
System  AC-Adaptive Link Generation 
NetCoach  Rules to infer next_best_page(D$_i$, U$_j$), learning_goal(X),

$\quad$ curriculum_sequencing(D$_1$$\dots$, D$_\ell$
ELM-ART II  Rules to infer next_best_page(D$_i$, U$_j$) (+ a tutoring component 

$\quad$ for the lisp domain) 
InterBook  Rules to infer prerequisite_based_help(D$_i$, U$_j$), learning_goal(D$_i$), 

$\quad$ reading_sequence(D$_i$, U$_j$), teach_me(D$_i$).
KBS Hyperbook  Rules to infer learning_sequence([C$_1$$\dots$, C$_n$], U$_j$), glossary(D$_i$

$\quad$ learning_goal([C$_1$$\dots$, C$_n$]), next_reasonable_goal(U$_j$

$\quad$ information_index([C$_1$$\dots$, C$_n$]) 

5. Discussion

In this paper, we have proposed a component-based definition of adaptive educational hypermedia systems that uses first-order logic to characterize AEHS. With this approach
During the application of the proposed characterization of AEHS, it turned out that the documents and their relations play a decisive role for the way how adaptation components draw conclusions. We have seen, that, in contrary to our intentions motivated by the transfer of Reiter's approach [10] to educational hypermedia, we were not able to generalize the diversity of rules for adaptation for a meta-description of adaptation. However, we claim that a logical characterization of adaptive educational hypermedia is a way to find solutions of current open questions in this area. E.g. currently, there is no catalogue of "metadata for adaptation" which could be used in LOM [9], SCORM [12] or other catalogues of metadata for education. The main objection is that adaptive educational hypermedia systems are "too different" to generalize for a meta-data driven description. From the above characterizations we can derive which meta-data is needed by the characterized AEHS: We can derive which sources for input data are used in the different systems from DOCS and OBS. These sources can now be used as a candidate set for meta-data for adaptation.

Further, our approach contributes to solutions for the open document space problem [8,2]: If we consider adaptive functionality as a query in open environments (as it has been done e.g. in [5]) it turns out that a decisive task is to determine the characteristics of adaptive functionality in order to define useful queries.

6. Conclusion

This paper proposes a component-based definition of adaptive educational hypermedia based on first-order logic. We have shown the applicability of such a formal description language for adaptive educational hypermedia in various examples. We claim that this logical characterization of adaptive educational hypermedia enables comparison of adaptive functionality in a well-grounded way, promotes the transfer of adaptive functionality to other educational hypermedia and web-based systems, defines rule-based descriptions of adaptivity, and supports the understanding of the role of metadata for adaptation.
 

Acknowledgment

We would like to thank Peter Brusilovsky and Gerhard Weber for the discussions on their adaptive educational hypermedia systems.

References

  1. BRUSILOVSKY, P., Methods and techniques of adaptive hypermedia. User Modeling and User Adapted Interaction 6, 2-3 (1996), 87-129.
  2. BRUSILOVSKY,P., Adaptive hypermedia. User Modeling and User-Adapted Interaction 11(2001), 87-110.
  3. BRUSILOVSKY,P., EKLUND, J.,AND SCHWARZ, E., Web-based Educations for All: A Tool for Development Adaptive Courseware. In Proceedings of the Sevenths International World Wide Web Conference, WWW'98(1998).
  4. BRUSILOVSKY,P.,AND MAYBURY, M., The Adaptive Web. Communications of the ACM, 2002.
  5. DOLOG,P., GAVRILOAIE, R., NEJDL, W.,AND BRASE, J., Integrating adaptive hypermedia techniques and open rdf-based environments. In International World Wide Web Conference(Budapest, Ungarn, May 2003).
  6. HENZE, N., AND NEJDL, W., Logically characterizing adaptive educational hypermedia systems. Tech. rep., University of Hannover, April 2003. http://www.kbs.uni-hannover.de/Arbeiten/Publikationen/2003/TechReportHenzeNejdl.pdf.
  7. HENZE,N.,AND NEJDL, W., Adaptation in open corpus hypermedia. IJAIED Special Issue on Adaptive and Intelligent Web-Based Systems 12(2001).
  8. HENZE,N.,AND NEJDL, W., Knowledge modeling for open adaptive hypermedia. In Proccedings of the 2nd International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH 2002)(Malaga, Spain, 2002).
  9. LOM: Draft Standard for Learning Object Metadata. http://ltsc.ieee.org/wg12/doc.html.
  10. REITER,R., A theory of diagnosis from first principles. Artifical Intelligence 32(1987).
  11. RUSSELL, S., AND NORVIG, P., Artificial Intelligence: A Modern Approach. Prentice Hall, 1995.
  12. SCORM: The sharable content object reference model, 2001. http://www.adlnet.org/Scorm/scorm.cfm.
  13. T. BERNERS-LEE, HENDLER,J.,AND LASSILA, O., The semantic web. Scientific American(May 2001).
  14. WEBER,G., KUHL, H.-C.,AND WEIBELZAHL, S., Developing adaptive internet based courses with the authoring system NetCoach. In Proceedings of the Third Workshop on Adaptive Hypermedia, AH2001(2001).
  15. WEBER,G.,AND SPECHT, M., User modeling and adaptive navigation support in WWW-based tutoring systems. In Proceedings of the Sixth International Conference on User Modeling, UM97(Sardinia, Italy, 1997).