Contents

• Introduction to SNNS
• Licensing, Copying and Acknowledgments
  • SNNS License
  • How to obtain SNNS
  • Installation
  • Acknowledgments
  • New Features of Release 4.1
• Neural Network Terminology
  • Building Blocks of Neural Nets
    • Units
    • Connections (Links)
    • Sites
  • Update Modes
  • Learning in Neural Nets
  • Generalization of Neural Networks
  • An Example of a simple Network
• Using the Graphical User Interface
  • Introduction to SNNS
    • Startup
    • Reading and Writing Files
    • Creating New Networks
    • Training Networks
      • Initialisation
      • Selecting a learning function
    • Saving Results for Testing
    • Further Explorations
    • SNNS File Formats
      • Pattern files
      • Network files
  • XGUI Files
  • Windows of XGUI
    • Manager Panel
    • File Browser
      • Loading and Saving Networks
      • Loading and Saving Patterns
      • Loading and Saving Configurations
      • Saving a Result file
      • Defining the Log File
    • Control Panel
    • Info Panel
      • Unit Function Displays
    • 2D Displays
      • Setup Panel of a 2D Display
    • Graph Window
    • Weight Display
    • Projection Panel
    • Print Panel
    • Help Windows
    • Shell window
    • Confirmer
  • Parameters of the Learning Functions
  • Update Functions
    • ART1_Stable
    • ART1_Synchronous
    • ART2_Stable
    • ART2_Synchronous
    • ARTMAP_Stable
    • ARTMAP_Synchronous
    • Auto_Synchronous
    • BAM_Order
    • BBTT_Order
    • CC_Order
    • CounterPropagation
    • Dynamic_LVQ
    • Hopfield_Fixed_Act
    • Hopfield_Synchronous
    • JE_Order
    • JE_Special
    • Kohonen_Order
    • RCC_Order
    • Random_Order
    • Random_Permutation
    • Serial_Order
    • Synchronous_Order
    • TimeDelay_Order
    • Topological_Order
  • Initialization Functions
    • ART1_Weights
    • ART2_Weights
    • ARTMAP_Weights
    • CC_Weights
    • ClippHebb
    • CPN_Rand_Pat
    • CPN_Weights_v3.2
    • CPN_Weights_v3.3
    • DLVQ_Weights
    • Hebb
    • Hebb_FixAct
    • JE_Weights
    • Kohonen_Weights_v3.2
    • Kohonen_Const
    • Kohonen_Rand_Pat
    • PseudoInv
    • Randomize_Weights
    • Random_Weights_Perc
    • RBF_Weights
    • RBF_Weights_Kohonen
    • RBF_Weights_Redo
    • RCC_Weights
    • RM_Random_Weights
  • Creating and Editing Unit Prototypes and Sites
• Handling Patterns with SNNS
  • Handling Pattern Sets
  • Fixed Size Patterns
  • Variable Size Patterns
• Graphical Network Editor
  • Editor Modes
  • Selection
    • Selection of Units
    • Selection of Links
  • Use of the Mouse
  • Short Command Reference
  • Editor Commands
  • Example Dialogue
• Network Creation Tools
  • BigNet for Feed-Forward Networks
    • Terminology of the Tool BigNet
    • Buttons of BigNet
    • Plane Editor
    • Link Editor
      • Example 1: Receptive Fields in Two Dimensions
      • Example 2: Moving in Different Dimensions
    • Create Net
  • BigNet for Time-Delay Networks
    • Terminology of Time-Delay BigNet
    • Plane Editor
    • Link Editor
  • BigNet for ART-Networks
  • BigNet for Self-Organizing Maps
  • BigNet for Autoassociative Memory Networks
  • BigNet for Partial Recurrent Networks
    • BigNet for Jordan Networks
    • BigNet for Elman Networks
• Network Analyzing Tools
  • Inversion
    • The Algorithm
    • Inversion Display
    • Example Session
  • Network Analyzer
    • The Network Analyzer Setup
    • The Display Control Window of the Network Analyzer
• Neural Network Models and Functions
  • Backpropagation Networks
    • Vanilla Backpropagation
    • Enhanced Backpropagation
    • Batch Backpropagation
    • Backpropagation with Weight Decay
  • Quickprop
  • RPROP
    • Changes in Release 3.3
    • General Description
    • Parameters
  • Backpercolation
  • Counterpropagation
    • Fundamentals
    • Initializing Counterpropagation
    • Counterpropagation Implementation in SNNS
  • Dynamic Learning Vector Quantization (DLVQ)
    • DLVQ Fundamentals
    • DLVQ in SNNS
    • Remarks
  • Backpropagation Through Time (BPTT)
  • The Cascade Correlation Algorithms
    • Cascade-Correlation (CC)
      • The Algorithm
      • Mathematical Background
    • Pruned-Cascade-Correlation (PCC)
      • The Algorithm
      • Mathematical Background
    • Recurrent Cascade-Correlation (RCC)
      • The Algorithm
      • Mathematical Background
    • Using the Cascade Algorithms in SNNS
  • Time Delay Networks (TDNNs)
    • TDNN Fundamentals
    • TDNN Implementation in SNNS
      • Activation Function
      • Update Function
      • Learning Function
    • Building and Using a Time Delay Network
  • Radial Basis Functions (RBFs)
    • RBF Fundamentals
    • RBF Implementation in SNNS
      • Activation Functions
      • Initialization Functions
        • RBF_Weights
        • RBF_Weights_Kohonen
        • RBF_Weights_Redo
      • Learning Functions
    • Building a Radial Basis Function Application
  • Dynamic Decay Adjustment for RBFs (RBF--DDA)
    • The Dynamic Decay Adjustment Algorithm
    • Using RBF--DDA in SNNS
  • ART Models in SNNS
    • ART1
      • Structure of an ART1 Network
      • Using ART1 Networks in SNNS
        • ART1 Initialization Function
        • ART1 Learning Function
        • ART1 Update Functions
    • ART2
      • Structure of an ART2 Network
      • Using ART2 Networks in SNNS
        • ART2 Initialization Function
        • ART2 Learning Function
        • ART2 Update Functions
    • ARTMAP
      • Structure of an ARTMAP Network
      • Using ARTMAP Networks in SNNS
        • ARTMAP Initialization Function
        • ARTMAP Learning Function
        • ARTMAP Update Functions
    • Topology of ART Networks in SNNS
  • Self-Organizing Maps (SOMs)
    • SOM Fundamentals
    • SOM Implementation in SNNS
      • The KOHONEN Learning Function
      • The Kohonen Update Function
      • The Kohonen Init Function
      • The Kohonen Activation Functions
      • Building and Training Self-Organizing Maps
      • Evaluation Tools for SOMs
  • Autoassociative Networks
    • General Characteristics
    • Layout of Autoassociative Networks
    • Hebbian Learning
    • McClelland & Rumelhart's Delta Rule
  • Partial Recurrent Networks
    • Models of Partial Recurrent Networks
      • Jordan Networks
      • Elman Networks
      • Extended Hierarchical Elman Networks
    • Working with Partial Recurrent Networks
      • The Initialization Function JE_Weights
      • Learning Functions
      • Update Functions
  • Stochastic Learning Functions
    • Monte-Carlo
    • Simulated Annealing
  • Scaled Conjugate Gradient (SCG)
    • Conjugate Gradient Methods (CGMs)
    • Main features of SCG
    • Parameters of SCG
    • Complexity of SCG
• Pruning Algorithms
  • Background of Pruning Algorithms
  • Theory of the implemented algorithms
    • Magnitude Based Pruning
    • Optimal Brain Damage
    • Optimal Brain Surgeon
    • Skeletonization
    • Non-contributing Units
  • Pruning Nets in SNNS
• 3D-Visualization of Neural Networks
  • Overview of the 3D Network Visualization
  • Use of the 3D-Interface
    • Structure of the 3D-Interface
    • Calling and Leaving the 3D Interface
    • Creating a 3D-Network
      • Concepts
      • Assigning a new z-Coordinate
      • Moving a z-Plane
      • Displaying the z-Coordinates
      • Example Dialogue to Create a 3D-Network
    • 3D-Control Panel
      • Transformation Panels
      • Setup Panel
      • Model Panel
      • Project Panel
      • Light Panel
      • Unit Panel
      • Links Panel
      • Reset Button
      • Freeze Button
    • 3D-Display Window
• SNNS for Workstation Clusters
  • SNNS RPC Programs
    • Xguirpc
    • Kernelrpc
  • Control Panels
    • SNNS RPC Panel
    • RPC Setup Panel
    • New Panel
    • Transfer Panels
    • Show Info Panel
  • RPC Errors
• Batchman
  • Introduction
    • Styling Conventions
    • Calling the Batch Interpreter
  • Description of the Batch Language
    • Structure of a Batch Program
    • Data Types and Variables
    • Variables
    • System Variables
    • Operators and Expressions
    • The Print Function
    • Control Structures
      • The If Instruction
      • The For Instruction
      • While and Repeat Instructions
  • SNNS Function Calls
    • Function Calls To Set SNNS Parameters
      • setInitFunc
      • setLearnFunc
      • setUpdateFunc
      • setPruningFunc
      • setSubPattern
      • setShuffle, setSubShuffle
    • Function Calls Related To Networks
    • Pattern Function Calls
    • Special Functions
  • Batchman Example Programs
    • Example 1
    • Example 2
    • Example 3
  • Snnsbat -- The predessor
    • The Snnsbat Environment
    • Using Snnsbat
    • Calling Snnsbat
• Tools for SNNS
  • Overview
  • Analyze
    • Analyzing Functions
  • Bignet
  • Convert2snns
    • Setup and Structure of a Control, Weight, Pattern File
  • Feedback-gennet
  • Mkhead
  • Mkout
  • Mkpat
  • Netlearn
  • Netperf
  • Pat_sel
  • Snns2c
    • Program Flow
    • Including the Compiled Network in the Own Application
      • Interfaces:
      • Example:
    • Special Network Architectures
      • TDNN:
      • CPN:
      • DLVQ:
      • BPTT:
    • Activation Functions
      • Supported Activation Functions:
      • Including Own Activation Functions:
    • Error Messages
• Kernel Function Interface
  • Overview
  • Unit Functions
    • Unit Enquiry and Manipulation Functions
    • Unit Definition Functions
  • Site Functions
    • Functions for the Definition of Sites
    • Functions for the Manipulation of Sites
  • Link Functions
  • Functions for the Manipulation of Prototypes
  • Functions to Read the Function Table
  • Network Initialization Functions
  • Functions for Activation Propagation in the Network
  • Learning and Pruning Functions
  • Functions for the Manipulation of Patterns
  • File I/O Functions
  • Functions to Search the Symbol Table
  • Miscelaneous other Interface Functions
  • Memory Management Functions
  • ART Interface Functions
  • Error Messages of the Simulator Kernel
• Transfer Functions
  • Predefined Transfer Functions
  • User Defined Transfer Functions
• Kernel File Interface
  • The ASCII Network File Format
  • Form of the Network File Entries
  • Grammar of the Network Files
    • Conventions
      • Lexical Elements of the Grammar
      • Definition of the Grammar
    • Terminal Symbols
    • Grammar:
  • Grammar of the Pattern Files
    • Terminal Symbols
    • Grammar
• Example Network Files
  • Example 1:
  • Example 2:
• References
• Index
• About this document ...