rev |
line source |
bshanks@112 | 1 Introduction
|
bshanks@112 | 2 Massive new datasets obtained with techniques such as in situ hybridization (ISH), immunohisto-
|
bshanks@112 | 3 chemistry, in situ transgenic reporter, microarray voxelation, and others, allow the expression levels
|
bshanks@112 | 4 of many genes at many locations to be compared. Our goal is to develop automated methods to
|
bshanks@112 | 5 relate spatial variation in gene expression to anatomy. We want to find marker genes for specific
|
bshanks@96 | 6 anatomical regions, and also to draw new anatomical maps based on gene expression patterns.
|
bshanks@112 | 7 We will validate these methods by applying them to 46 anatomical areas within the cerebral cortex,
|
bshanks@112 | 8 by using the Allen Mouse Brain Atlas coronal dataset (ABA).
|
bshanks@112 | 9 This project has three primary goals:
|
bshanks@112 | 10 (1) develop an algorithm to screen spatial gene expression data for combinations of marker
|
bshanks@112 | 11 genes which selectively target anatomical regions.
|
bshanks@112 | 12 (2) develop an algorithm to suggest new ways of carving up a structure into anatomically dis-
|
bshanks@112 | 13 tinct regions, based on spatial patterns in gene expression.
|
bshanks@112 | 14 (3) adapt our tools for the analysis of multi/hyperspectral imaging data from the Geographic
|
bshanks@112 | 15 Information Systems (GIS) community.
|
bshanks@112 | 16 We will create a 2-D “flat map” dataset of the mouse cerebral cortex that contains a flattened
|
bshanks@112 | 17 version of the Allen Mouse Brain Atlas ISH data, as well as the boundaries of cortical anatomical
|
bshanks@112 | 18 areas. We will use this dataset to validate the methods developed in (1) and (2). In addition to
|
bshanks@112 | 19 its use in neuroscience, this dataset will be useful as a sample dataset for the machine learning
|
bshanks@112 | 20 community.
|
bshanks@112 | 21 Although our particular application involves the 3D spatial distribution of gene expression, the
|
bshanks@112 | 22 methods we will develop will generalize to any high-dimensional data over points located in a low-
|
bshanks@112 | 23 dimensional space. In particular, our methods could be applied to the analysis of multi/hyperspectral
|
bshanks@112 | 24 imaging data, or alternately to genome-wide sequencing data derived from sets of tissues and dis-
|
bshanks@112 | 25 ease states.
|
bshanks@112 | 26 All algorithms that we develop will be implemented in a GPL open-source software toolkit. The
|
bshanks@112 | 27 toolkit and the datasets will be published and freely available for others to use.
|
bshanks@112 | 28 __________________
|
bshanks@112 | 29 Background and related work
|
bshanks@112 | 30 Cortical anatomy
|
bshanks@112 | 31 The cortex is divided into areas and layers. Because of the cortical columnar organization, the
|
bshanks@112 | 32 parcellation of the cortex into areas can be drawn as a 2-D map on the surface of the cortex. In the
|
bshanks@112 | 33 third dimension, the boundaries between the areas continue downwards into the cortical depth,
|
bshanks@112 | 34 perpendicular to the surface. The layer boundaries run parallel to the surface. One can picture an
|
bshanks@112 | 35 area of the cortex as a slice of a six-layered cake1.
|
bshanks@112 | 36 It is known that different cortical areas have distinct roles in both normal functioning and in
|
bshanks@112 | 37 disease processes, yet there are no known marker genes for most cortical areas. When it is nec-
|
bshanks@112 | 38 essary to divide a tissue sample into cortical areas, this is a manual process that requires a skilled
|
bshanks@112 | 39 1Outside of isocortex, the number of layers varies.
|
bshanks@112 | 40 1
|
bshanks@112 | 41
|
bshanks@112 | 42 human to combine multiple visual cues and interpret them in the context of their approximate
|
bshanks@112 | 43 location upon the cortical surface.
|
bshanks@112 | 44 Even the questions of how many areas should be recognized in cortex, and what their arrange-
|
bshanks@112 | 45 ment is, are still not completely settled. A proposed division of the cortex into areas is called a
|
bshanks@112 | 46 cortical map. In the rodent, the lack of a single agreed-upon map can be seen by contrasting the
|
bshanks@112 | 47 recent maps given by Swanson[21] on the one hand, and Paxinos and Franklin[16] on the other.
|
bshanks@112 | 48 While the maps are certainly very similar in their general arrangement, significant differences re-
|
bshanks@112 | 49 main.
|
bshanks@112 | 50 The Allen Mouse Brain Atlas dataset
|
bshanks@112 | 51 The Allen Mouse Brain Atlas (ABA) data[13] were produced by doing in-situ hybridization on
|
bshanks@112 | 52 slices of male, 56-day-old C57BL/6J mouse brains. Pictures were taken of the processed slice,
|
bshanks@112 | 53 and these pictures were semi-automatically analyzed to create a digital measurement of gene
|
bshanks@112 | 54 expression levels at each location in each slice. Per slice, cellular spatial resolution is achieved.
|
bshanks@112 | 55 Using this method, a single physical slice can only be used to measure one single gene; many
|
bshanks@112 | 56 different mouse brains were needed in order to measure the expression of many genes.
|
bshanks@112 | 57 Mus musculus is thought to contain about 22,000 protein-coding genes[26]. The ABA contains
|
bshanks@112 | 58 data on about 20,000 genes in sagittal sections, out of which over 4,000 genes are also measured
|
bshanks@112 | 59 in coronal sections. Our dataset is derived from only the coronal subset of the ABA2. An auto-
|
bshanks@112 | 60 mated nonlinear alignment procedure located the 2D data from the various slices in a single 3D
|
bshanks@112 | 61 coordinate system. In the final 3D coordinate system, voxels are cubes with 200 microns on a
|
bshanks@112 | 62 side. There are 67x41x58 = 159,326 voxels, of which 51,533 are in the brain[15]. For each voxel
|
bshanks@112 | 63 and each gene, the expression energy[13] within that voxel is made available.
|
bshanks@112 | 64 The ABA is not the only large public spatial gene expression dataset[8][25][5][14][24][4][23][20][3].
|
bshanks@112 | 65 However, with the exception of the ABA, GenePaint[25], and EMAGE[24], most of the other re-
|
bshanks@112 | 66 sources have not (yet) extracted the expression intensity from the ISH images and registered the
|
bshanks@112 | 67 results into a single 3-D space.
|
bshanks@112 | 68 The remainder of the background section will be divided into three parts, one for each major
|
bshanks@112 | 69 goal.
|
bshanks@112 | 70 Goal 1, From Areas to Genes: Given a map of regions, find genes that mark those regions
|
bshanks@112 | 71 Machine learning terminology: classifiers The task of looking for marker genes for known
|
bshanks@112 | 72 anatomical regions means that one is looking for a set of genes such that, if the expression level
|
bshanks@112 | 73 of those genes is known, then the locations of the regions can be inferred.
|
bshanks@112 | 74 If we define the regions so that they cover the entire anatomical structure to be subdivided,
|
bshanks@112 | 75 and restrict ourselves to looking at one voxel at a time, we may say that we are using gene
|
bshanks@112 | 76 expression in each voxel to assign that voxel to the proper area. We call this a classification
|
bshanks@112 | 77 task, because each voxel is being assigned to a class (namely, its region). An understanding
|
bshanks@112 | 78 of the relationship between the combination of gene expression levels and the locations of the
|
bshanks@112 | 79 regions may be expressed as a function. The input to this function is a voxel, along with the gene
|
bshanks@112 | 80 expression levels within that voxel; the output is the regional identity of the target voxel, that is, the
|
bshanks@112 | 81 ____________________________________
|
bshanks@112 | 82 2The sagittal data do not cover the entire cortex, and also have greater registration error[15]. Genes were selected
|
bshanks@112 | 83 by the Allen Institute for coronal sectioning based on, “classes of known neuroscientific interest... or through post hoc
|
bshanks@112 | 84 identification of a marked non-ubiquitous expression pattern”[15].
|
bshanks@112 | 85 2
|
bshanks@112 | 86
|
bshanks@112 | 87 region to which the target voxel belongs. We call this function a classifier. In general, the input to
|
bshanks@112 | 88 a classifier is called an instance, and the output is called a label (or a class label).
|
bshanks@112 | 89 Our goal is not to produce a single classifier, but rather to develop an automated method for
|
bshanks@112 | 90 determining a classifier for any known anatomical structure. Therefore, we seek a procedure by
|
bshanks@112 | 91 which a gene expression dataset may be analyzed in concert with an anatomical atlas in order to
|
bshanks@112 | 92 produce a classifier. The initial gene expression dataset used in the construction of the classifier
|
bshanks@112 | 93 is called training data. In the machine learning literature, this sort of procedure may be thought
|
bshanks@112 | 94 of as a supervised learning task, defined as a task in which the goal is to learn a mapping from
|
bshanks@112 | 95 instances to labels, and the training data consists of a set of instances (voxels) for which the labels
|
bshanks@112 | 96 (regions) are known.
|
bshanks@112 | 97 Each gene expression level is called a feature, and the selection of which genes3 to look at is
|
bshanks@112 | 98 called feature selection. Feature selection is one component of the task of learning a classifier.
|
bshanks@112 | 99 One class of feature selection methods assigns some sort of score to each candidate gene.
|
bshanks@112 | 100 The top-ranked genes are then chosen. Some scoring measures can assign a score to a set of
|
bshanks@112 | 101 selected genes, not just to a single gene; in this case, a dynamic procedure may be used in which
|
bshanks@112 | 102 features are added and subtracted from the selected set depending on how much they raise the
|
bshanks@112 | 103 score. Such procedures are called “stepwise” or “greedy”.
|
bshanks@112 | 104 Although the classifier itself may only look at the gene expression data within each voxel be-
|
bshanks@112 | 105 fore classifying that voxel, the algorithm which constructs the classifier may look over the entire
|
bshanks@112 | 106 dataset. We can categorize score-based feature selection methods depending on how the score
|
bshanks@112 | 107 of calculated. Often the score calculation consists of assigning a sub-score to each voxel, and
|
bshanks@112 | 108 then aggregating these sub-scores into a final score. If only information from nearby voxels is
|
bshanks@112 | 109 used to calculate a voxel’s sub-score, then we say it is a local scoring method. If only information
|
bshanks@112 | 110 from the voxel itself is used to calculate a voxel’s sub-score, then we say it is a pointwise scoring
|
bshanks@112 | 111 method.
|
bshanks@112 | 112 Our Strategy for Goal 1
|
bshanks@112 | 113 Key questions when choosing a learning method are: What are the instances? What are the
|
bshanks@112 | 114 features? How are the features chosen? Here are four principles that outline our answers to these
|
bshanks@112 | 115 questions.
|
bshanks@112 | 116 Principle 1: Combinatorial gene expression
|
bshanks@112 | 117 It is too much to hope that every anatomical region of interest will be identified by a single
|
bshanks@112 | 118 gene. For example, in the cortex, there are some areas which are not clearly delineated by any
|
bshanks@112 | 119 gene included in the ABA coronal dataset. However, at least some of these areas can be delin-
|
bshanks@112 | 120 eated by looking at combinations of genes (an example of an area for which multiple genes are
|
bshanks@112 | 121 necessary and sufficient is provided in Preliminary Results, Figure 4). Therefore, each instance
|
bshanks@112 | 122 should contain multiple features (genes).
|
bshanks@112 | 123 Principle 2: Only look at combinations of small numbers of genes
|
bshanks@112 | 124 When the classifier classifies a voxel, it is only allowed to look at the expression of the genes
|
bshanks@112 | 125 which have been selected as features. The more data that are available to a classifier, the better
|
bshanks@112 | 126 that it can do. Why not include every gene as a feature? The reason is that we wish to employ the
|
bshanks@112 | 127 classifier in situations in which it is not feasible to gather data about every gene. For example, if we
|
bshanks@112 | 128 ____________________________________
|
bshanks@112 | 129 3Strictly speaking, the features are gene expression levels, but we’ll call them genes.
|
bshanks@112 | 130 3
|
bshanks@112 | 131
|
bshanks@112 | 132 want to use the expression of marker genes as a trigger for some regionally-targeted intervention,
|
bshanks@112 | 133 then our intervention must contain a molecular mechanism to check the expression level of each
|
bshanks@112 | 134 marker gene before it triggers. It is currently infeasible to design a molecular trigger that checks
|
bshanks@112 | 135 the level of more than a handful of genes. Therefore, we must select only a few genes as features.
|
bshanks@112 | 136 The requirement to find combinations of only a small number of genes limits us from straightfor-
|
bshanks@112 | 137 wardly applying many of the most simple techniques from the field of supervised machine learning.
|
bshanks@112 | 138 In the parlance of machine learning, our task combines feature selection with supervised learning.
|
bshanks@112 | 139 Principle 3: Use geometry in feature selection
|
bshanks@112 | 140 When doing feature selection with score-based methods, the simplest thing to do would be
|
bshanks@112 | 141 to score the performance of each voxel by itself and then combine these scores (pointwise scor-
|
bshanks@112 | 142 ing). A more powerful approach is to also use information about the geometric relations between
|
bshanks@112 | 143 each voxel and its neighbors; this requires non-pointwise, local scoring methods. See Preliminary
|
bshanks@112 | 144 Results, figure 3 for evidence of the complementary nature of pointwise and local scoring methods.
|
bshanks@112 | 145 Principle 4: Work in 2-D whenever possible
|
bshanks@112 | 146 There are many anatomical structures which are commonly characterized in terms of a two-
|
bshanks@112 | 147 dimensional manifold. When it is known that the structure that one is looking for is two-dimensional,
|
bshanks@112 | 148 the results may be improved by allowing the analysis algorithm to take advantage of this prior
|
bshanks@112 | 149 knowledge. In addition, it is easier for humans to visualize and work with 2-D data.
|
bshanks@112 | 150 Goal 2, From Genes to Areas: given gene expression data, discover a map of regions
|
bshanks@101 | 151 Machine learning terminology: clustering
|
bshanks@112 | 152 If one is given a dataset consisting merely of instances, with no class labels, then analysis of
|
bshanks@112 | 153 the dataset is referred to as unsupervised learning in the jargon of machine learning. One thing
|
bshanks@112 | 154 that you can do with such a dataset is to group instances together. A set of similar instances is
|
bshanks@112 | 155 called a cluster, and the activity of grouping the data into clusters is called clustering or cluster
|
bshanks@112 | 156 analysis.
|
bshanks@112 | 157 The task of deciding how to carve up a structure into anatomical regions can be put into these
|
bshanks@112 | 158 terms. The instances are once again voxels (or pixels) along with their associated gene expression
|
bshanks@112 | 159 profiles. We make the assumption that voxels from the same anatomical region have similar gene
|
bshanks@112 | 160 expression profiles, at least compared to the other regions. This means that clustering voxels is
|
bshanks@112 | 161 the same as finding potential regions; we seek a partitioning of the voxels into regions, that is, into
|
bshanks@112 | 162 clusters of voxels with similar gene expression.
|
bshanks@112 | 163 It is desirable to determine not just one set of regions, but also how these regions relate to
|
bshanks@112 | 164 each other. The outcome of clustering may be a hierarchical tree of clusters, rather than a single
|
bshanks@112 | 165 set of clusters which partition the voxels. This is called hierarchical clustering.
|
bshanks@112 | 166 Similarity scores A crucial choice when designing a clustering method is how to measure
|
bshanks@112 | 167 similarity, across either pairs of instances, or clusters, or both. There is much overlap between
|
bshanks@112 | 168 scoring methods for feature selection (discussed above under Goal 1) and scoring methods for
|
bshanks@112 | 169 similarity.
|
bshanks@112 | 170 Dimensionality reduction In this section, we discuss reducing the length of the per-pixel gene
|
bshanks@112 | 171 expression feature vector. By “dimension”, we mean the dimension of this vector, not the spatial
|
bshanks@112 | 172 4
|
bshanks@112 | 173
|
bshanks@112 | 174 dimension of the underlying data.
|
bshanks@112 | 175
|
bshanks@112 | 176
|
bshanks@104 | 177 Figure 1: Top row: Genes Nfic
|
bshanks@112 | 178 and A930001M12Rik are the most
|
bshanks@104 | 179 correlated with area SS (somatosen-
|
bshanks@112 | 180 sory cortex). Bottom row: Genes
|
bshanks@104 | 181 C130038G02Rik and Cacna1i are
|
bshanks@112 | 182 those with the best fit using logistic
|
bshanks@104 | 183 regression. Within each picture, the
|
bshanks@104 | 184 vertical axis roughly corresponds to
|
bshanks@104 | 185 anterior at the top and posterior at the
|
bshanks@104 | 186 bottom, and the horizontal axis roughly
|
bshanks@104 | 187 corresponds to medial at the left and
|
bshanks@104 | 188 lateral at the right. The red outline is
|
bshanks@104 | 189 the boundary of region SS. Pixels are
|
bshanks@104 | 190 colored according to correlation, with
|
bshanks@104 | 191 red meaning high correlation and blue
|
bshanks@112 | 192 meaning low. Unlike Goal 1, there is no externally-imposed need to
|
bshanks@112 | 193 select only a handful of informative genes for inclusion
|
bshanks@112 | 194 in the instances. However, some clustering algorithms
|
bshanks@112 | 195 perform better on small numbers of features4. There are
|
bshanks@112 | 196 techniques which “summarize” a larger number of fea-
|
bshanks@112 | 197 tures using a smaller number of features; these tech-
|
bshanks@112 | 198 niques go by the name of feature extraction or dimen-
|
bshanks@112 | 199 sionality reduction. The small set of features that such a
|
bshanks@112 | 200 technique yields is called the reduced feature set. Note
|
bshanks@112 | 201 that the features in the reduced feature set do not neces-
|
bshanks@112 | 202 sarily correspond to genes; each feature in the reduced
|
bshanks@112 | 203 set may be any function of the set of gene expression
|
bshanks@112 | 204 levels.
|
bshanks@112 | 205 Clustering genes rather than voxels Although the
|
bshanks@112 | 206 ultimate goal is to cluster the instances (voxels or pixels),
|
bshanks@112 | 207 one strategy to achieve this goal is to first cluster the
|
bshanks@112 | 208 features (genes). There are two ways that clusters of
|
bshanks@112 | 209 genes could be used.
|
bshanks@112 | 210 Gene clusters could be used as part of dimensionality
|
bshanks@112 | 211 reduction: rather than have one feature for each gene,
|
bshanks@112 | 212 we could have one reduced feature for each gene cluster.
|
bshanks@112 | 213 Gene clusters could also be used to directly yield a
|
bshanks@112 | 214 clustering on instances. This is because many genes
|
bshanks@112 | 215 have an expression pattern which seems to pick out a
|
bshanks@112 | 216 single, spatially contiguous region. This suggests the fol-
|
bshanks@112 | 217 lowing procedure: cluster together genes which pick out
|
bshanks@112 | 218 similar regions, and then to use the more popular com-
|
bshanks@112 | 219 mon regions as the final clusters. In Preliminary Results,
|
bshanks@112 | 220 Figure 7, we show that a number of anatomically recog-
|
bshanks@112 | 221 nized cortical regions, as well as some “superregions” formed by lumping together a few regions,
|
bshanks@112 | 222 are associated with gene clusters in this fashion.
|
bshanks@112 | 223 Goal 3: interoperability with multi/hyperspectral imaging analysis software
|
bshanks@112 | 224 A typical color image associates each pixel with a vector of three values. Multispectral and hyper-
|
bshanks@112 | 225 spectral images, however, are images which associate each pixel with a vector containing many
|
bshanks@112 | 226 values. The different positions in the vector correspond to different bands of electromagnetic
|
bshanks@112 | 227 wavelengths5.
|
bshanks@112 | 228 Some analysis techniques for hyperspectral imaging, especially preprocessing and calibration
|
bshanks@112 | 229 techniques, make use of the information that the different values captured at each pixel represent
|
bshanks@112 | 230 ____________________________________
|
bshanks@112 | 231 4First, because the number of features in the reduced dataset is less than in the original dataset, the running time of
|
bshanks@112 | 232 clustering algorithms may be much less. Second, it is thought that some clustering algorithms may give better results
|
bshanks@112 | 233 on reduced data.
|
bshanks@112 | 234 5In hyperspectral imaging, the bands are adjacent, and the number of different bands is larger. For conciseness, we
|
bshanks@112 | 235 discuss only hyperspectral imaging, but our methods are also well suited to multispectral imaging with many bands.
|
bshanks@112 | 236 5
|
bshanks@112 | 237
|
bshanks@112 | 238 adjacent wavelengths of light, which can be combined to make a spectrum. Other analysis tech-
|
bshanks@112 | 239 niques ignore the interpretation of the values measured, and their relationship to each other within
|
bshanks@112 | 240 the electromagnetic spectrum, instead treating them blindly as completely separate features.
|
bshanks@112 | 241 With both hyperspectral imaging and spatial gene expression data, each location in space
|
bshanks@112 | 242 is associated with more than three numerical feature values. The analysis of hyperspectral im-
|
bshanks@112 | 243 ages can involve supervised classification and unsupervised learning. Often hyperspectral images
|
bshanks@112 | 244 come from satellites looking at the Earth, and it is desirable to classify what sort of objects occupy
|
bshanks@112 | 245 a given area of land. Sometimes detailed training data is not available, in which case it is desirable
|
bshanks@112 | 246 at least to cluster together those regions of land which contain similar objects.
|
bshanks@112 | 247 We believe that it may be possible for these two different field to share some common compu-
|
bshanks@112 | 248 tational tools. To this end, we intend to make use of existing hyperspectral imaging software when
|
bshanks@112 | 249 possible, and to develop new software in such a way so as to make it easy to use for the purpose
|
bshanks@112 | 250 of hyperspectral image analysis, as well as for our primary purpose of spatial gene expression
|
bshanks@112 | 251 data analysis.
|
bshanks@112 | 252 Related work
|
bshanks@112 | 253
|
bshanks@112 | 254 Figure 2: Gene Pitx2
|
bshanks@112 | 255 is selectively underex-
|
bshanks@112 | 256 pressed in area SS. As noted above, the GIS community has developed tools for supervised
|
bshanks@112 | 257 classification and unsupervised clustering in the context of the analysis
|
bshanks@112 | 258 of hyperspectral imaging data. One tool is Spectral Python6. Spectral
|
bshanks@112 | 259 Python implements various supervised and unsupervised classification
|
bshanks@112 | 260 methods, as well as utility functions for loading, viewing, and saving
|
bshanks@112 | 261 spatial data. Although Spectral Python has feature extraction methods
|
bshanks@112 | 262 (such as principal components analysis) which create a small set of
|
bshanks@112 | 263 new features computed based on the original features, it does not have
|
bshanks@112 | 264 feature selection methods, that is, methods to select a small subset
|
bshanks@112 | 265 out of the original features (although feature selection in hyperspectral
|
bshanks@112 | 266 imaging has been investigated by others[19].
|
bshanks@112 | 267 There is a substantial body of work on the analysis of gene expression data. Most of this con-
|
bshanks@112 | 268 cerns gene expression data which are not fundamentally spatial7. Here we review only that work
|
bshanks@112 | 269 which concerns the automated analysis of spatial gene expression data with respect to anatomy.
|
bshanks@112 | 270 Relating to Goal 1, GeneAtlas[5] and EMAGE [24] allow the user to construct a search query by
|
bshanks@112 | 271 demarcating regions and then specifying either the strength of expression or the name of another
|
bshanks@112 | 272 gene or dataset whose expression pattern is to be matched. Neither GeneAtlas nor EMAGE allow
|
bshanks@112 | 273 one to search for combinations of genes that define a region in concert.
|
bshanks@112 | 274 Relating to Goal 2, EMAGE[24] allows the user to select a dataset from among a large number
|
bshanks@112 | 275 of alternatives, or by running a search query, and then to cluster the genes within that dataset.
|
bshanks@112 | 276 EMAGE clusters via hierarchical complete linkage clustering.
|
bshanks@112 | 277 [15] describes AGEA, ”Anatomic Gene Expression Atlas”. AGEA has three components. Gene
|
bshanks@112 | 278 Finder: The user selects a seed voxel and the system (1) chooses a cluster which includes the
|
bshanks@112 | 279 seed voxel, (2) yields a list of genes which are overexpressed in that cluster. Correlation: The user
|
bshanks@112 | 280 selects a seed voxel and the system then shows the user how much correlation there is between
|
bshanks@112 | 281 the gene expression profile of the seed voxel and every other voxel. Clusters: AGEA includes a
|
bshanks@112 | 282 ____________________________________
|
bshanks@112 | 283 6http://spectralpython.sourceforge.net/
|
bshanks@112 | 284 7By “fundamentally spatial” we mean that there is information from a large number of spatial locations indexed by
|
bshanks@112 | 285 spatial coordinates; not just data which have only a few different locations or which is indexed by anatomical label.
|
bshanks@112 | 286 6
|
bshanks@112 | 287
|
bshanks@112 | 288 preset hierarchical clustering of voxels based on a recursive bifurcation algorithm with correlation
|
bshanks@112 | 289 as the similarity metric. AGEA has been applied to the cortex. The paper describes interesting
|
bshanks@112 | 290 results on the structure of correlations between voxel gene expression profiles within a handful of
|
bshanks@112 | 291 cortical areas. However, that analysis neither looks for genes marking cortical areas, nor does it
|
bshanks@112 | 292 suggest a cortical map based on gene expression data. Neither of the other components of AGEA
|
bshanks@112 | 293 can be applied to cortical areas; AGEA’s Gene Finder cannot be used to find marker genes for the
|
bshanks@112 | 294 cortical areas; and AGEA’s hierarchical clustering does not produce clusters corresponding to the
|
bshanks@112 | 295 cortical areas8.
|
bshanks@112 | 296
|
bshanks@112 | 297
|
bshanks@104 | 298 Figure 3: The top row shows the two
|
bshanks@104 | 299 genes which (individually) best predict
|
bshanks@104 | 300 area AUD, according to logistic regres-
|
bshanks@112 | 301 sion. The bottom row shows the two
|
bshanks@112 | 302 genes which (individually) best match
|
bshanks@112 | 303 area AUD, according to gradient sim-
|
bshanks@104 | 304 ilarity. From left to right and top to
|
bshanks@104 | 305 bottom, the genes are Ssr1, Efcbp1,
|
bshanks@112 | 306 Ptk7, and Aph1a. [6] looks at the mean expression level of genes within
|
bshanks@112 | 307 anatomical regions, and applies a Student’s t-test to de-
|
bshanks@112 | 308 termine whether the mean expression level of a gene is
|
bshanks@112 | 309 significantly higher in the target region. This relates to
|
bshanks@112 | 310 our Goal 1. [6] also clusters genes, relating to our Goal
|
bshanks@112 | 311 2. For each cluster, prototypical spatial expression pat-
|
bshanks@112 | 312 terns were created by averaging the genes in the cluster.
|
bshanks@112 | 313 The prototypes were analyzed manually, without cluster-
|
bshanks@112 | 314 ing voxels.
|
bshanks@112 | 315 These related works differ from our strategy for Goal
|
bshanks@112 | 316 1 in at least three ways. First, they find only single genes,
|
bshanks@112 | 317 whereas we will also look for combinations of genes.
|
bshanks@112 | 318 Second, they usually can only use overexpression as
|
bshanks@112 | 319 a marker, whereas we will also search for underexpres-
|
bshanks@112 | 320 sion. Third, they use scores based on pointwise expres-
|
bshanks@112 | 321 sion levels, whereas we will also use geometric scores
|
bshanks@112 | 322 such as gradient similarity (described in Preliminary Re-
|
bshanks@112 | 323 sults). Figures 4, 2, and 3 in the Preliminary Results
|
bshanks@112 | 324 section contain evidence that each of our three choices
|
bshanks@112 | 325 is the right one.
|
bshanks@112 | 326 [10] describes a technique to find combinations of
|
bshanks@112 | 327 marker genes to pick out an anatomical region. They
|
bshanks@112 | 328 use an evolutionary algorithm to evolve logical operators which combine boolean (thresholded)
|
bshanks@112 | 329 images in order to match a target image. They apply their technique for finding combinations of
|
bshanks@112 | 330 marker genes for the purpose of clustering genes around a “seed gene”.
|
bshanks@112 | 331 Relating to our Goal 2, some researchers have attempted to parcellate cortex on the basis of
|
bshanks@112 | 332 non-gene expression data. For example, [17], [2], [18], and [1] associate spots on the cortex with
|
bshanks@112 | 333 the radial profile9 of response to some stain ([12] uses MRI), extract features from this profile, and
|
bshanks@112 | 334 then use similarity between surface pixels to cluster.
|
bshanks@112 | 335 [22] describes an analysis of the anatomy of the hippocampus using the ABA dataset. In
|
bshanks@112 | 336 addition to manual analysis, two clustering methods were employed, a modified Non-negative
|
bshanks@112 | 337 Matrix Factorization (NNMF), and a hierarchical bifurcation clustering scheme using correlation as
|
bshanks@112 | 338 ____________________________________
|
bshanks@112 | 339 8In both cases, the cause is that pairwise correlations between the gene expression of voxels in different areas but
|
bshanks@112 | 340 the same layer are often stronger than pairwise correlations between the gene expression of voxels in different layers
|
bshanks@112 | 341 but the same area. Therefore, a pairwise voxel correlation clustering algorithm will tend to create clusters representing
|
bshanks@112 | 342 cortical layers, not areas.
|
bshanks@112 | 343 9A radial profile is a profile along a line perpendicular to the cortical surface.
|
bshanks@112 | 344 7
|
bshanks@112 | 345
|
bshanks@112 | 346 similarity. The paper yielded impressive results, proving the usefulness of computational genomic
|
bshanks@112 | 347 anatomy. We have run NNMF on the cortical dataset, and while the results are promising, other
|
bshanks@112 | 348 methods may perform as well or better (see Preliminary Results, Figure 6).
|
bshanks@112 | 349 Comparing previous work with our Goal 1, there has been fruitful work on finding marker genes,
|
bshanks@112 | 350 but only one of the projects explored combinations of marker genes, and none of them compared
|
bshanks@112 | 351 the results obtained by using different algorithms or scoring methods. Comparing previous work
|
bshanks@112 | 352 with Goal 2, although some projects obtained clusterings, there has not been much comparison
|
bshanks@112 | 353 between different algorithms or scoring methods, so it is likely that the best clustering method for
|
bshanks@112 | 354 this application has not yet been found. Also, none of these projects did a separate dimensionality
|
bshanks@112 | 355 reduction step before clustering pixels, or tried to cluster genes first in order to guide automated
|
bshanks@112 | 356 clustering of pixels into spatial regions, or used co-clustering algorithms.
|
bshanks@112 | 357 In summary, (a) only one of the previous projects explores combinations of marker genes, (b)
|
bshanks@112 | 358 there has been almost no comparison of different algorithms or scoring methods, and (c) there
|
bshanks@112 | 359 has been no work on computationally finding marker genes applied to cortical areas, or on finding
|
bshanks@112 | 360 a hierarchical clustering that will yield a map of cortical areas de novo from gene expression data.
|
bshanks@112 | 361 Our project is guided by a concrete application with a well-specified criterion of success (how
|
bshanks@112 | 362 well we can find marker genes for / reproduce the layout of cortical areas), which will provide a
|
bshanks@112 | 363 solid basis for comparing different methods.
|
bshanks@112 | 364 _________________________________________________
|
bshanks@112 | 365 Data sharing plan
|
bshanks@112 | 366
|
bshanks@112 | 367
|
bshanks@104 | 368 Figure 4: Upper left: wwc1. Upper
|
bshanks@104 | 369 right: mtif2. Lower left: wwc1 + mtif2
|
bshanks@104 | 370 (each pixel’s value on the lower left is
|
bshanks@104 | 371 the sum of the corresponding pixels in
|
bshanks@112 | 372 the upper row). We are enthusiastic about the sharing of methods and
|
bshanks@112 | 373 data, and at the conclusion of the project, we will make
|
bshanks@112 | 374 all of our data and computer source code publically avail-
|
bshanks@112 | 375 able, either in supplemental attachments to publications,
|
bshanks@112 | 376 or on a website. The source code will be released under
|
bshanks@112 | 377 the GNU Public License. We intend to include a soft-
|
bshanks@112 | 378 ware program which, when run, will take as input the
|
bshanks@112 | 379 Allen Brain Atlas raw data, and produce as output all
|
bshanks@112 | 380 numbers and charts found in publications resulting from
|
bshanks@112 | 381 the project. Source code to be released will include ex-
|
bshanks@112 | 382 tensions to Caret[7], an existing open-source scientific
|
bshanks@112 | 383 imaging program, and to Spectral Python. Data to be
|
bshanks@112 | 384 released will include the 2-D “flat map” dataset. This
|
bshanks@112 | 385 dataset will be submitted to a machine learning dataset
|
bshanks@112 | 386 repository.
|
bshanks@112 | 387 Broader impacts
|
bshanks@112 | 388 In addition to validating the usefulness of the algorithms,
|
bshanks@112 | 389 the application of these methods to cortex will produce
|
bshanks@112 | 390 immediate benefits, because there are currently no known genetic markers for most cortical areas.
|
bshanks@112 | 391 The method developed in Goal 1 will be applied to each cortical area to find a set of marker
|
bshanks@112 | 392 genes such that the combinatorial expression pattern of those genes uniquely picks out the target
|
bshanks@112 | 393 area. Finding marker genes will be useful for drug discovery as well as for experimentation be-
|
bshanks@112 | 394 cause marker genes can be used to design interventions which selectively target individual cortical
|
bshanks@112 | 395 areas.
|
bshanks@112 | 396 8
|
bshanks@112 | 397
|
bshanks@112 | 398 The application of the marker gene finding algorithm to the cortex will also support the develop-
|
bshanks@112 | 399 ment of new neuroanatomical methods. In addition to finding markers for each individual cortical
|
bshanks@112 | 400 areas, we will find a small panel of genes that can find many of the areal boundaries at once.
|
bshanks@112 | 401 The method developed in Goal 2 will provide a genoarchitectonic viewpoint that will contribute
|
bshanks@112 | 402 to the creation of a better cortical map.
|
bshanks@112 | 403 The methods we will develop will be applicable to other datasets beyond the brain, and even to
|
bshanks@112 | 404 datasets outside of biology. The software we develop will be useful for the analysis of hyperspectral
|
bshanks@112 | 405 images. Our project will draw attention to this area of overlap between neuroscience and GIS, and
|
bshanks@112 | 406 may lead to future collaborations between these two fields. The cortical dataset that we produce
|
bshanks@112 | 407 will be useful in the machine learning community as a sample dataset that new algorithms can be
|
bshanks@112 | 408 tested against. The availability of this sample dataset to the machine learning community may lead
|
bshanks@112 | 409 to more interest in the design of machine learning algorithms to analyze spatial gene expression.
|
bshanks@112 | 410 _
|
bshanks@112 | 411 Preliminary Results
|
bshanks@112 | 412 Format conversion between SEV, MATLAB, NIFTI
|
bshanks@112 | 413 We have created software to (politely) download all of the SEV files10 from the Allen Institute
|
bshanks@112 | 414 website. We have also created software to convert between the SEV, MATLAB, and NIFTI file
|
bshanks@112 | 415 formats, as well as some of Caret’s file formats.
|
bshanks@112 | 416 Flatmap of cortex
|
bshanks@112 | 417 We downloaded the ABA data and selected only those voxels which belong to cerebral cortex.
|
bshanks@112 | 418 We divided the cortex into hemispheres. Using Caret[7], we created a mesh representation of the
|
bshanks@112 | 419 surface of the selected voxels. For each gene, and for each node of the mesh, we calculated an
|
bshanks@112 | 420 average of the gene expression of the voxels “underneath” that mesh node. We then flattened
|
bshanks@112 | 421 the cortex, creating a two-dimensional mesh. We converted this grid into a MATLAB matrix. We
|
bshanks@112 | 422 manually traced the boundaries of each of 46 cortical areas from the ABA coronal reference atlas
|
bshanks@112 | 423 slides, and converted this region data into MATLAB format.
|
bshanks@112 | 424 At this point, the data are in the form of a number of 2-D matrices, all in registration, with the
|
bshanks@112 | 425 matrix entries representing a grid of points (pixels) over the cortical surface. There is one 2-D
|
bshanks@112 | 426 matrix whose entries represent the regional label associated with each surface pixel. And for each
|
bshanks@112 | 427 gene, there is a 2-D matrix whose entries represent the average expression level underneath each
|
bshanks@112 | 428 surface pixel. The features and the target area are both functions on the surface pixels. They can
|
bshanks@112 | 429 be referred to as scalar fields over the space of surface pixels; alternately, they can be thought of
|
bshanks@112 | 430 as images which can be displayed on the flatmapped surface.
|
bshanks@112 | 431 Feature selection and scoring methods
|
bshanks@112 | 432 Underexpression of a gene can serve as a marker Underexpression of a gene can sometimes
|
bshanks@112 | 433 serve as a marker. For example, see Figure 2.
|
bshanks@112 | 434 Correlation Recall that the instances are surface pixels, and consider the problem of attempt-
|
bshanks@112 | 435 ing to classify each instance as either a member of a particular anatomical area, or not. The target
|
bshanks@112 | 436 area can be represented as a boolean mask over the surface pixels.
|
bshanks@112 | 437 10SEV is a sparse format for spatial data. It is the format in which the ABA data is made available.
|
bshanks@112 | 438 9
|
bshanks@112 | 439
|
bshanks@112 | 440 We calculated the correlation between each gene and each cortical area. The top row of Figure
|
bshanks@112 | 441 1 shows the three genes most correlated with area SS.
|
bshanks@112 | 442 Conditional entropy
|
bshanks@112 | 443 For each region, we created and ran a forward stepwise procedure which attempted to find
|
bshanks@112 | 444 pairs of genes such that the conditional entropy of the target area’s boolean mask, conditioned
|
bshanks@112 | 445 upon the gene pair’s thresholded expression levels, is minimized.
|
bshanks@112 | 446 This finds pairs of genes which are most informative (at least at these threshold levels) relative
|
bshanks@112 | 447 to the question, “Is this surface pixel a member of the target area?”. The advantage over linear
|
bshanks@112 | 448 methods such as logistic regression is that this takes account of arbitrarily nonlinear relationships;
|
bshanks@112 | 449 for example, if the XOR of two variables predicts the target, conditional entropy would notice,
|
bshanks@112 | 450 whereas linear methods would not.
|
bshanks@112 | 451 Gradient similarity We noticed that the previous two scoring methods, which are pointwise,
|
bshanks@112 | 452 often found genes whose pattern of expression did not look similar in shape to the target region.
|
bshanks@112 | 453 For this reason we designed a non-pointwise scoring method to detect when a gene had a pattern
|
bshanks@112 | 454 of expression which looked like it had a boundary whose shape is similar to the shape of the target
|
bshanks@112 | 455 region. We call this scoring method “gradient similarity”. The formula is:
|
bshanks@112 | 456 ∑
|
bshanks@112 | 457 pixel<img src="cmsy8-32.png" alt="∈" />pixels cos(∠∇1 -∠∇2) ⋅|∇1| + |∇2|
|
bshanks@112 | 458 2 ⋅ pixel_value1 + pixel_value2
|
bshanks@112 | 459 2
|
bshanks@112 | 460 where ∇1 and ∇2 are the gradient vectors of the two images at the current pixel; ∠∇i is the
|
bshanks@112 | 461 angle of the gradient of image i at the current pixel; |∇i| is the magnitude of the gradient of image
|
bshanks@112 | 462 i at the current pixel; and pixel_valuei is the value of the current pixel in image i.
|
bshanks@112 | 463 The intuition is that we want to see if the borders of the pattern in the two images are similar; if
|
bshanks@112 | 464 the borders are similar, then both images will have corresponding pixels with large gradients (be-
|
bshanks@112 | 465 cause this is a border) which are oriented in a similar direction (because the borders are similar).
|
bshanks@112 | 466 Gradient similarity provides information complementary to correlation
|
bshanks@112 | 467 To show that gradient similarity can provide useful information that cannot be detected via
|
bshanks@112 | 468 pointwise analyses, consider Fig. 3. The pointwise method in the top row identifies genes which
|
bshanks@112 | 469 express more strongly in AUD than outside of it; its weakness is that this includes many areas
|
bshanks@112 | 470 which don’t have a salient border matching the areal border. The geometric method identifies
|
bshanks@112 | 471 genes whose salient expression border seems to partially line up with the border of AUD; its
|
bshanks@112 | 472 weakness is that this includes genes which don’t express over the entire area.
|
bshanks@112 | 473 Areas which can be identified by single genes Using gradient similarity, we have already
|
bshanks@112 | 474 found single genes which roughly identify some areas and groupings of areas. For each of these
|
bshanks@112 | 475 areas, an example of a gene which roughly identifies it is shown in Figure 5. We have not yet
|
bshanks@112 | 476 cross-verified these genes in other atlases.
|
bshanks@112 | 477 In addition, there are a number of areas which are almost identified by single genes: COAa+NLOT
|
bshanks@112 | 478 (anterior part of cortical amygdalar area, nucleus of the lateral olfactory tract), ENT (entorhinal),
|
bshanks@112 | 479 ACAv (ventral anterior cingulate), VIS (visual), AUD (auditory).
|
bshanks@112 | 480 These results validate our expectation that the ABA dataset can be exploited to find marker
|
bshanks@112 | 481 genes for many cortical areas, while also validating the relevancy of our new scoring method,
|
bshanks@112 | 482 gradient similarity.
|
bshanks@112 | 483 10
|
bshanks@112 | 484
|
bshanks@112 | 485
|
bshanks@112 | 486
|
bshanks@112 | 487
|
bshanks@112 | 488
|
bshanks@104 | 489 Figure 5: From left to right and top
|
bshanks@104 | 490 to bottom, single genes which roughly
|
bshanks@104 | 491 identify areas SS (somatosensory pri-
|
bshanks@112 | 492 mary + supplemental), SSs (supple-
|
bshanks@104 | 493 mental somatosensory), PIR (piriform),
|
bshanks@112 | 494 FRP (frontal pole), RSP (retrosplenial),
|
bshanks@112 | 495 COApm (Cortical amygdalar, poste-
|
bshanks@112 | 496 rior part, medial zone). Grouping
|
bshanks@112 | 497 some areas together, we have also
|
bshanks@112 | 498 found genes to identify the groups
|
bshanks@104 | 499 ACA+PL+ILA+DP+ORB+MO (anterior
|
bshanks@104 | 500 cingulate, prelimbic, infralimbic, dor-
|
bshanks@104 | 501 sal peduncular, orbital, motor), poste-
|
bshanks@112 | 502 rior and lateral visual (VISpm, VISpl,
|
bshanks@104 | 503 VISI, VISp; posteromedial, posterolat-
|
bshanks@112 | 504 eral, lateral, and primary visual; the
|
bshanks@104 | 505 posterior and lateral visual area is dis-
|
bshanks@104 | 506 tinguished from its neighbors, but not
|
bshanks@104 | 507 from the entire rest of the cortex). The
|
bshanks@112 | 508 genes are Pitx2, Aldh1a2, Ppfibp1,
|
bshanks@112 | 509 Slco1a5, Tshz2, Trhr, Col12a1, Ets1. Combinations of multiple genes are useful and
|
bshanks@112 | 510 necessary for some areas
|
bshanks@112 | 511 In Figure 4, we give an example of a cortical area
|
bshanks@112 | 512 which is not marked by any single gene, but which can be
|
bshanks@112 | 513 identified combinatorially. According to logistic regres-
|
bshanks@112 | 514 sion, gene wwc1 is the best fit single gene for predicting
|
bshanks@112 | 515 whether or not a pixel on the cortical surface belongs to
|
bshanks@112 | 516 the motor area (area MO). The upper-left picture in Fig-
|
bshanks@112 | 517 ure 4 shows wwc1’s spatial expression pattern over the
|
bshanks@112 | 518 cortex. The lower-right boundary of MO is represented
|
bshanks@112 | 519 reasonably well by this gene, but the gene overshoots
|
bshanks@112 | 520 the upper-left boundary. This flattened 2-D representa-
|
bshanks@112 | 521 tion does not show it, but the area corresponding to the
|
bshanks@112 | 522 overshoot is the medial surface of the cortex. MO is only
|
bshanks@112 | 523 found on the dorsal surface. Gene mtif2 is shown in the
|
bshanks@112 | 524 upper-right. Mtif2 captures MO’s upper-left boundary, but
|
bshanks@112 | 525 not its lower-right boundary. Mtif2 does not express very
|
bshanks@112 | 526 much on the medial surface. By adding together the val-
|
bshanks@112 | 527 ues at each pixel in these two figures, we get the lower-
|
bshanks@112 | 528 left image. This combination captures area MO much
|
bshanks@112 | 529 better than any single gene.
|
bshanks@112 | 530 This shows that our proposal to develop a method to
|
bshanks@112 | 531 find combinations of marker genes is both possible and
|
bshanks@112 | 532 necessary.
|
bshanks@112 | 533 Multivariate supervised learning
|
bshanks@112 | 534 Forward stepwise logistic regression Logistic regres-
|
bshanks@112 | 535 sion is a popular method for predictive modeling of cat-
|
bshanks@112 | 536 egorical data. As a pilot run, for five cortical areas (SS,
|
bshanks@112 | 537 AUD, RSP, VIS, and MO), we performed forward step-
|
bshanks@112 | 538 wise logistic regression to find single genes, pairs of
|
bshanks@112 | 539 genes, and triplets of genes which predict areal identify.
|
bshanks@112 | 540 This is an example of feature selection integrated with
|
bshanks@112 | 541 prediction using a stepwise wrapper. Some of the sin-
|
bshanks@112 | 542 gle genes found were shown in various figures through-
|
bshanks@112 | 543 out this document, and Figure 4 shows a combination of
|
bshanks@112 | 544 genes which was found.
|
bshanks@112 | 545 SVM on all genes at once
|
bshanks@112 | 546 In order to see how well one can do when looking at
|
bshanks@112 | 547 all genes at once, we ran a support vector machine to
|
bshanks@112 | 548 classify cortical surface pixels based on their gene ex-
|
bshanks@112 | 549 pression profiles. We achieved classification accuracy of
|
bshanks@112 | 550 about 81%11. However, as noted above, a classifier that
|
bshanks@112 | 551 ____________________________________
|
bshanks@112 | 552 115-fold cross-validation.
|
bshanks@112 | 553 11
|
bshanks@112 | 554
|
bshanks@112 | 555 looks at all the genes at once isn’t as practically useful
|
bshanks@112 | 556 as a classifier that uses only a few genes.
|
bshanks@112 | 557 Data-driven redrawing of the cortical map
|
bshanks@112 | 558 We have applied the following dimensionality reduction algorithms to reduce the dimensionality
|
bshanks@112 | 559 of the gene expression profile associated with each pixel: Principal Components Analysis (PCA),
|
bshanks@112 | 560 Simple PCA, Multi-Dimensional Scaling, Isomap, Landmark Isomap, Laplacian eigenmaps, Local
|
bshanks@112 | 561 Tangent Space Alignment, Stochastic Proximity Embedding, Fast Maximum Variance Unfolding,
|
bshanks@112 | 562 Non-negative Matrix Factorization (NNMF). Space constraints prevent us from showing many of
|
bshanks@112 | 563 the results, but as a sample, PCA, NNMF, and landmark Isomap are shown in the first, second,
|
bshanks@112 | 564 and third rows of Figure 6.
|
bshanks@112 | 565 After applying the dimensionality reduction, we ran clustering algorithms on the reduced data.
|
bshanks@112 | 566 To date we have tried k-means and spectral clustering. The results of k-means after PCA, NNMF,
|
bshanks@112 | 567 and landmark Isomap are shown in the bottom row of Figure 6. To compare, the leftmost picture
|
bshanks@112 | 568 on the bottom row of Figure 6 shows some of the major subdivisions of cortex. These results show
|
bshanks@112 | 569 that different dimensionality reduction techniques capture different aspects of the data and lead
|
bshanks@112 | 570 to different clusterings, indicating the utility of our proposal to produce a detailed comparison of
|
bshanks@112 | 571 these techniques as applied to the domain of genomic anatomy.
|
bshanks@112 | 572 Many areas are captured by clusters of genes We also clustered the genes using gradient
|
bshanks@112 | 573 similarity to see if the spatial regions defined by any clusters matched known anatomical regions.
|
bshanks@112 | 574 Figure 7 shows, for ten sample gene clusters, each cluster’s average expression pattern, com-
|
bshanks@112 | 575 pared to a known anatomical boundary. This suggests that it is worth attempting to cluster genes,
|
bshanks@112 | 576 and then to use the results to cluster pixels.
|
bshanks@112 | 577 Our plan: what remains to be done
|
bshanks@112 | 578 Flatmap cortex and segment cortical layers
|
bshanks@112 | 579 There are multiple ways to flatten 3-D data into 2-D. We will compare mappings from manifolds to
|
bshanks@112 | 580 planes which attempt to preserve size (such as the one used by Caret[7]) with mappings which
|
bshanks@112 | 581 preserve angle (conformal maps). We will also develop a segmentation algorithm to automatically
|
bshanks@112 | 582 identify the layer boundaries.
|
bshanks@112 | 583 Develop algorithms that find genetic markers for anatomical regions
|
bshanks@112 | 584 Scoring measures and feature selection We will develop scoring methods for evaluating how
|
bshanks@112 | 585 good individual genes are at marking areas. We will compare pointwise, geometric, and information-
|
bshanks@112 | 586 theoretic measures. We already developed one entirely new scoring method (gradient similarity),
|
bshanks@112 | 587 but we may develop more. Scoring measures that we will explore will include the L1 norm, cor-
|
bshanks@112 | 588 relation, expression energy ratio, conditional entropy, gradient similarity, Jaccard similarity, Dice
|
bshanks@112 | 589 similarity, Hough transform, and statistical tests such as Student’s t-test, and the Mann-Whitney
|
bshanks@112 | 590 U test (a non-parametric test). In addition, any classifier induces a scoring measure on genes by
|
bshanks@112 | 591 taking the prediction error when using that gene to predict the target.
|
bshanks@112 | 592 Using some combination of these measures, we will develop a procedure to find single marker
|
bshanks@112 | 593 genes for anatomical regions: for each cortical area, we will rank the genes by their ability to
|
bshanks@112 | 594 delineate that area. We will quantitatively compare the list of single genes generated by our
|
bshanks@112 | 595 method to the lists generated by methods which are mentioned in Related Work.
|
bshanks@112 | 596 12
|
bshanks@112 | 597
|
bshanks@112 | 598
|
bshanks@104 | 599 Figure 6: First row: the first 6 reduced dimensions, using PCA. Sec-
|
bshanks@112 | 600 ond row: the first 6 reduced dimensions, using NNMF. Third row: the
|
bshanks@112 | 601 first six reduced dimensions, using landmark Isomap. Bottom row:
|
bshanks@112 | 602 examples of kmeans clustering applied to reduced datasets to find
|
bshanks@112 | 603 7 clusters. Left: 19 of the major subdivisions of the cortex. Sec-
|
bshanks@112 | 604 ond from left: PCA. Third from left: NNMF. Right: Landmark Isomap.
|
bshanks@112 | 605 Additional details: In the third and fourth rows, 7 dimensions were
|
bshanks@112 | 606 found, but only 6 displayed. In the last row: for PCA, 50 dimensions
|
bshanks@112 | 607 were used; for NNMF, 6 dimensions were used; for landmark Isomap,
|
bshanks@112 | 608 7 dimensions were used. Some cortical areas have
|
bshanks@112 | 609 no single marker genes but
|
bshanks@112 | 610 can be identified by com-
|
bshanks@112 | 611 binatorial coding. This re-
|
bshanks@112 | 612 quires multivariate scoring
|
bshanks@112 | 613 measures and feature se-
|
bshanks@112 | 614 lection procedures. Many
|
bshanks@112 | 615 of the measures, such
|
bshanks@112 | 616 as expression energy, gra-
|
bshanks@112 | 617 dient similarity, Jaccard,
|
bshanks@112 | 618 Dice, Hough, Student’s t,
|
bshanks@112 | 619 and Mann-Whitney U are
|
bshanks@112 | 620 univariate. We will ex-
|
bshanks@112 | 621 tend these scoring mea-
|
bshanks@112 | 622 sures for use in multivariate
|
bshanks@112 | 623 feature selection, that is,
|
bshanks@112 | 624 for scoring how well com-
|
bshanks@112 | 625 binations of genes, rather
|
bshanks@112 | 626 than individual genes, can
|
bshanks@112 | 627 distinguish a target area.
|
bshanks@112 | 628 There are existing mul-
|
bshanks@112 | 629 tivariate forms of some
|
bshanks@112 | 630 of the univariate scoring
|
bshanks@112 | 631 measures, for example,
|
bshanks@112 | 632 Hotelling’s T-square is a
|
bshanks@112 | 633 multivariate analog of Stu-
|
bshanks@112 | 634 dent’s t.
|
bshanks@112 | 635 We will develop a fea-
|
bshanks@112 | 636 ture selection procedure for choosing the best small set of marker genes for a given anatomical
|
bshanks@112 | 637 area. In addition to using the scoring measures that we develop, we will also explore (a) feature
|
bshanks@112 | 638 selection using a stepwise wrapper over “vanilla” classifiers such as logistic regression, (b) super-
|
bshanks@112 | 639 vised learning methods such as decision trees which incrementally/greedily combine single gene
|
bshanks@112 | 640 markers into sets, and (c) supervised learning methods which use soft constraints to minimize
|
bshanks@112 | 641 number of features used, such as sparse support vector machines (SVMs).
|
bshanks@112 | 642 Since errors of displacement and of shape may cause genes and target areas to match less
|
bshanks@112 | 643 than they should, we will consider the robustness of feature selection methods in the presence of
|
bshanks@112 | 644 error. Some of these methods, such as the Hough transform, are designed to be resistant in the
|
bshanks@112 | 645 presence of error, but many are not.
|
bshanks@112 | 646 An area may be difficult to identify because the boundaries are misdrawn in the atlas, or be-
|
bshanks@112 | 647 cause the shape of the natural domain of gene expression corresponding to the area is different
|
bshanks@112 | 648 from the shape of the area as recognized by anatomists. We will develop extensions to our pro-
|
bshanks@112 | 649 cedure which (a) detect when a difficult area could be fit if its boundary were redrawn slightly12,
|
bshanks@112 | 650 ____________________________________
|
bshanks@112 | 651 12Not just any redrawing is acceptable, only those which appear to be justified as a natural spatial domain of gene ex-
|
bshanks@112 | 652 pression by multiple sources of evidence. Interestingly, the need to detect “natural spatial domains of gene expression”
|
bshanks@112 | 653 in a data-driven fashion means that the methods of Goal 2 might be useful in achieving Goal 1, as well – particularly
|
bshanks@112 | 654 13
|
bshanks@112 | 655
|
bshanks@112 | 656 and (b) detect when a difficult area could be combined with adjacent areas to create a larger area
|
bshanks@112 | 657 which can be fit.
|
bshanks@112 | 658 A future publication on the method that we develop in Goal 1 will review the scoring measures
|
bshanks@112 | 659 and quantitatively compare their performance in order to provide a foundation for future research
|
bshanks@112 | 660 of methods of marker gene finding. We will measure the robustness of the scoring measures as
|
bshanks@112 | 661 well as their absolute performance on our dataset.
|
bshanks@112 | 662 Develop algorithms to suggest a division of a structure into anatomical parts
|
bshanks@112 | 663
|
bshanks@112 | 664 Figure 7: Prototypes corresponding to sample gene clus-
|
bshanks@112 | 665 ters, clustered by gradient similarity. Region boundaries for
|
bshanks@112 | 666 the region that most matches each prototype are overlaid. Dimensionality reduction on gene
|
bshanks@112 | 667 expression profiles We have al-
|
bshanks@112 | 668 ready described the application of
|
bshanks@112 | 669 ten dimensionality reduction algo-
|
bshanks@112 | 670 rithms for the purpose of replacing
|
bshanks@112 | 671 the gene expression profiles, which
|
bshanks@112 | 672 are vectors of about 4000 gene ex-
|
bshanks@112 | 673 pression levels, with a smaller num-
|
bshanks@112 | 674 ber of features. We plan to further ex-
|
bshanks@112 | 675 plore and interpret these results, as
|
bshanks@112 | 676 well as to apply other unsupervised
|
bshanks@112 | 677 learning algorithms, including inde-
|
bshanks@112 | 678 pendent components analysis, self-
|
bshanks@112 | 679 organizing maps, and generative models such as deep Boltzmann machines. We will explore
|
bshanks@112 | 680 ways to quantitatively compare the relevance of the different dimensionality reduction methods for
|
bshanks@112 | 681 identifying cortical areal boundaries.
|
bshanks@112 | 682 Dimensionality reduction on pixels Instead of applying dimensionality reduction to the gene
|
bshanks@112 | 683 expression profiles, the same techniques can be applied instead to the pixels. It is possible that
|
bshanks@112 | 684 the features generated in this way by some dimensionality reduction techniques will directly corre-
|
bshanks@112 | 685 spond to interesting spatial regions.
|
bshanks@112 | 686 Clustering and segmentation on pixels We will explore clustering and image segmentation
|
bshanks@112 | 687 algorithms in order to segment the pixels into regions. We will explore k-means, spectral cluster-
|
bshanks@112 | 688 ing, gene shaving[9], recursive division clustering, multivariate generalizations of edge detectors,
|
bshanks@112 | 689 multivariate generalizations of watershed transformations, region growing, active contours, graph
|
bshanks@112 | 690 partitioning methods, and recursive agglomerative clustering with various linkage functions. These
|
bshanks@112 | 691 methods can be combined with dimensionality reduction.
|
bshanks@112 | 692 Clustering on genes We have already shown that the procedure of clustering genes according
|
bshanks@112 | 693 to gradient similarity, and then creating an averaged prototype of each cluster’s expression pattern,
|
bshanks@112 | 694 yields some spatial patterns which match cortical areas (Figure 7). We will further explore the
|
bshanks@112 | 695 clustering of genes.
|
bshanks@112 | 696 In addition to using the cluster expression prototypes directly to identify spatial regions, this
|
bshanks@112 | 697 might be useful as a component of dimensionality reduction. For example, one could imagine
|
bshanks@112 | 698 clustering similar genes and then replacing their expression levels with a single average expression
|
bshanks@112 | 699 ____________________________________
|
bshanks@112 | 700 discriminative dimensionality reduction.
|
bshanks@112 | 701 14
|
bshanks@112 | 702
|
bshanks@112 | 703 level, thereby removing some redundancy from the gene expression profiles. One could then
|
bshanks@112 | 704 perform clustering on pixels (possibly after a second dimensionality reduction step) in order to
|
bshanks@112 | 705 identify spatial regions. It remains to be seen whether removal of redundancy would help or hurt
|
bshanks@112 | 706 the ultimate goal of identifying interesting spatial regions.
|
bshanks@112 | 707 Co-clustering We will explore some algorithms which simultaneously incorporate clustering
|
bshanks@112 | 708 on instances and on features (in our case, pixels and genes), for example, IRM[11]. These are
|
bshanks@112 | 709 called co-clustering or biclustering algorithms.
|
bshanks@112 | 710 Compare different methods In order to tell which method is best for genomic anatomy, for
|
bshanks@112 | 711 each experimental method we will compare the cortical map found by unsupervised learning to a
|
bshanks@112 | 712 cortical map derived from the Allen Reference Atlas. We will explore various quantitative metrics
|
bshanks@112 | 713 that purport to measure how similar two clusterings are, such as Jaccard, Rand index, Fowlkes-
|
bshanks@112 | 714 Mallows, variation of information, Larsen, Van Dongen, and others.
|
bshanks@112 | 715 Discriminative dimensionality reduction In addition to using a purely data-driven approach
|
bshanks@112 | 716 to identify spatial regions, it might be useful to see how well the known regions can be recon-
|
bshanks@112 | 717 structed from a small number of features, even if those features are chosen by using knowledge of
|
bshanks@112 | 718 the regions. For example, linear discriminant analysis could be used as a dimensionality reduction
|
bshanks@112 | 719 technique in order to identify a few features which are the best linear summary of gene expression
|
bshanks@112 | 720 profiles for the purpose of discriminating between regions. This reduced feature set could then be
|
bshanks@112 | 721 used to cluster pixels into regions. Perhaps the resulting clusters will be similar to the reference
|
bshanks@112 | 722 atlas, yet more faithful to natural spatial domains of gene expression than the reference atlas is.
|
bshanks@112 | 723 Apply the new methods to the cortex
|
bshanks@112 | 724 Using the methods developed in Goal 1, we will present, for each cortical area, a short list of
|
bshanks@112 | 725 markers to identify that area; and we will also present lists of “panels” of genes that can be used
|
bshanks@112 | 726 to delineate many areas at once.
|
bshanks@112 | 727 Because in most cases the ABA coronal dataset only contains one ISH per gene, it is possible
|
bshanks@112 | 728 for an unrelated combination of genes to seem to identify an area when in fact it is only coinci-
|
bshanks@112 | 729 dence. There are three ways we will validate our marker genes to guard against this. First, we
|
bshanks@112 | 730 will confirm that putative combinations of marker genes express the same pattern in both hemi-
|
bshanks@112 | 731 spheres. Second, we will manually validate our final results on other gene expression datasets
|
bshanks@112 | 732 such as EMAGE, GeneAtlas, and GENSAT[8]. Third, we may conduct ISH experiments jointly with
|
bshanks@112 | 733 collaborators to get further data on genes of particular interest.
|
bshanks@112 | 734 Using the methods developed in Goal 2, we will present one or more hierarchical cortical
|
bshanks@112 | 735 maps. We will identify and explain how the statistical structure in the gene expression data led to
|
bshanks@112 | 736 any unexpected or interesting features of these maps, and we will provide biological hypotheses
|
bshanks@112 | 737 to interpret any new cortical areas, or groupings of areas, which are discovered.
|
bshanks@112 | 738 Apply the new methods to hyperspectral datasets
|
bshanks@112 | 739 Our software will be able to read and write file formats common in the hyperspectral imaging
|
bshanks@112 | 740 community such as Erdas LAN and ENVI, and it will be able to convert between the SEV and NIFTI
|
bshanks@112 | 741 formats from neuroscience and the ENVI format from GIS. The methods developed in Goals 1 and
|
bshanks@112 | 742 2 will be implemented either as part of Spectral Python or as a separate tool that interoperates
|
bshanks@112 | 743 with Spectral Python. The methods will be run on hyperspectral satellite image datasets, and their
|
bshanks@112 | 744 performance will be compared to existing hyperspectral analysis techniques.
|
bshanks@112 | 745 15
|
bshanks@112 | 746
|
bshanks@112 | 747 References Cited
|
bshanks@112 | 748 [1] Chris Adamson, Leigh Johnston, Terrie Inder, Sandra Rees, Iven Mareels, and Gary Egan.
|
bshanks@112 | 749 A Tracking Approach to Parcellation of the Cerebral Cortex, volume 3749/2005 of Lecture
|
bshanks@112 | 750 Notes in Computer Science, pages 294–301. Springer Berlin / Heidelberg, 2005.
|
bshanks@112 | 751 [2] J. Annese, A. Pitiot, I. D. Dinov, and A. W. Toga. A myelo-architectonic method for the struc-
|
bshanks@112 | 752 tural classification of cortical areas. NeuroImage, 21(1):15–26, 2004.
|
bshanks@112 | 753 [3] Tanya Barrett, Dennis B. Troup, Stephen E. Wilhite, Pierre Ledoux, Dmitry Rudnev, Carlos
|
bshanks@112 | 754 Evangelista, Irene F. Kim, Alexandra Soboleva, Maxim Tomashevsky, and Ron Edgar. NCBI
|
bshanks@112 | 755 GEO: mining tens of millions of expression profiles–database and tools update. Nucl. Acids
|
bshanks@112 | 756 Res., 35(suppl_1):D760–765, 2007.
|
bshanks@112 | 757 [4] George W. Bell, Tatiana A. Yatskievych, and Parker B. Antin. GEISHA, a whole-mount in
|
bshanks@112 | 758 situ hybridization gene expression screen in chicken embryos. Developmental Dynamics,
|
bshanks@112 | 759 229(3):677–687, 2004.
|
bshanks@112 | 760 [5] James P Carson, Tao Ju, Hui-Chen Lu, Christina Thaller, Mei Xu, Sarah L Pallas, Michael C
|
bshanks@112 | 761 Crair, Joe Warren, Wah Chiu, and Gregor Eichele. A digital atlas to characterize the mouse
|
bshanks@112 | 762 brain transcriptome. PLoS Comput Biol, 1(4):e41, 2005.
|
bshanks@112 | 763 [6] Mark H. Chin, Alex B. Geng, Arshad H. Khan, Wei-Jun Qian, Vladislav A. Petyuk, Jyl Boline,
|
bshanks@112 | 764 Shawn Levy, Arthur W. Toga, Richard D. Smith, Richard M. Leahy, and Desmond J. Smith.
|
bshanks@112 | 765 A genome-scale map of expression for a mouse brain section obtained using voxelation.
|
bshanks@112 | 766 Physiol. Genomics, 30(3):313–321, August 2007.
|
bshanks@112 | 767 [7] D C Van Essen, H A Drury, J Dickson, J Harwell, D Hanlon, and C H Anderson. An integrated
|
bshanks@112 | 768 software suite for surface-based analyses of cerebral cortex. Journal of the American Medical
|
bshanks@112 | 769 Informatics Association: JAMIA, 8(5):443–59, 2001. PMID: 11522765.
|
bshanks@112 | 770 [8] Shiaoching Gong, Chen Zheng, Martin L. Doughty, Kasia Losos, Nicholas Didkovsky, Uta B.
|
bshanks@112 | 771 Schambra, Norma J. Nowak, Alexandra Joyner, Gabrielle Leblanc, Mary E. Hatten, and
|
bshanks@112 | 772 Nathaniel Heintz. A gene expression atlas of the central nervous system based on bacte-
|
bshanks@112 | 773 rial artificial chromosomes. Nature, 425(6961):917–925, October 2003.
|
bshanks@112 | 774 [9] Trevor Hastie, Robert Tibshirani, Michael Eisen, Ash Alizadeh, Ronald Levy, Louis Staudt,
|
bshanks@112 | 775 Wing Chan, David Botstein, and Patrick Brown. ’Gene shaving’ as a method for identifying dis-
|
bshanks@112 | 776 tinct sets of genes with similar expression patterns. Genome Biology, 1(2):research0003.1–
|
bshanks@112 | 777 research0003.21, 2000.
|
bshanks@112 | 778 [10] Jano Hemert and Richard Baldock. Matching Spatial Regions with Combinations of Interact-
|
bshanks@112 | 779 ing Gene Expression Patterns, volume 13 of Communications in Computer and Information
|
bshanks@112 | 780 Science, pages 347–361. Springer Berlin Heidelberg, 2008.
|
bshanks@112 | 781 [11] C Kemp, JB Tenenbaum, TL Griffiths, T Yamada, and N Ueda. Learning systems of concepts
|
bshanks@112 | 782 with an infinite relational model. In AAAI, 2006.
|
bshanks@112 | 783 [12] F. Kruggel, M. K. Brckner, Th. Arendt, C. J. Wiggins, and D. Y. von Cramon. Analyzing the
|
bshanks@112 | 784 neocortical fine-structure. Medical Image Analysis, 7(3):251–264, September 2003.
|
bshanks@112 | 785 16
|
bshanks@112 | 786
|
bshanks@112 | 787 [13] Ed S. Lein, Michael J. Hawrylycz, Nancy Ao, Mikael Ayres, Amy Bensinger, Amy Bernard,
|
bshanks@112 | 788 Andrew F. Boe, Mark S. Boguski, Kevin S. Brockway, Emi J. Byrnes, Lin Chen, Li Chen,
|
bshanks@112 | 789 Tsuey-Ming Chen, Mei Chi Chin, Jimmy Chong, Brian E. Crook, Aneta Czaplinska, Chinh N.
|
bshanks@112 | 790 Dang, Suvro Datta, Nick R. Dee, Aimee L. Desaki, Tsega Desta, Ellen Diep, Tim A. Dolbeare,
|
bshanks@112 | 791 Matthew J. Donelan, Hong-Wei Dong, Jennifer G. Dougherty, Ben J. Duncan, Amanda J.
|
bshanks@112 | 792 Ebbert, Gregor Eichele, Lili K. Estin, Casey Faber, Benjamin A. Facer, Rick Fields, Shanna R.
|
bshanks@112 | 793 Fischer, Tim P. Fliss, Cliff Frensley, Sabrina N. Gates, Katie J. Glattfelder, Kevin R. Halverson,
|
bshanks@112 | 794 Matthew R. Hart, John G. Hohmann, Maureen P. Howell, Darren P. Jeung, Rebecca A. John-
|
bshanks@112 | 795 son, Patrick T. Karr, Reena Kawal, Jolene M. Kidney, Rachel H. Knapik, Chihchau L. Kuan,
|
bshanks@112 | 796 James H. Lake, Annabel R. Laramee, Kirk D. Larsen, Christopher Lau, Tracy A. Lemon,
|
bshanks@112 | 797 Agnes J. Liang, Ying Liu, Lon T. Luong, Jesse Michaels, Judith J. Morgan, Rebecca J. Mor-
|
bshanks@112 | 798 gan, Marty T. Mortrud, Nerick F. Mosqueda, Lydia L. Ng, Randy Ng, Geralyn J. Orta, Car-
|
bshanks@112 | 799 oline C. Overly, Tu H. Pak, Sheana E. Parry, Sayan D. Pathak, Owen C. Pearson, Ralph B.
|
bshanks@112 | 800 Puchalski, Zackery L. Riley, Hannah R. Rockett, Stephen A. Rowland, Joshua J. Royall,
|
bshanks@112 | 801 Marcos J. Ruiz, Nadia R. Sarno, Katherine Schaffnit, Nadiya V. Shapovalova, Taz Sivisay,
|
bshanks@112 | 802 Clifford R. Slaughterbeck, Simon C. Smith, Kimberly A. Smith, Bryan I. Smith, Andy J. Sodt,
|
bshanks@112 | 803 Nick N. Stewart, Kenda-Ruth Stumpf, Susan M. Sunkin, Madhavi Sutram, Angelene Tam,
|
bshanks@112 | 804 Carey D. Teemer, Christina Thaller, Carol L. Thompson, Lee R. Varnam, Axel Visel, Ray M.
|
bshanks@112 | 805 Whitlock, Paul E. Wohnoutka, Crissa K. Wolkey, Victoria Y. Wong, Matthew Wood, Murat B.
|
bshanks@112 | 806 Yaylaoglu, Rob C. Young, Brian L. Youngstrom, Xu Feng Yuan, Bin Zhang, Theresa A. Zwing-
|
bshanks@112 | 807 man, and Allan R. Jones. Genome-wide atlas of gene expression in the adult mouse brain.
|
bshanks@112 | 808 Nature, 445(7124):168–176, 2007.
|
bshanks@112 | 809 [14] Susan Magdaleno, Patricia Jensen, Craig L. Brumwell, Anna Seal, Karen Lehman, Andrew
|
bshanks@112 | 810 Asbury, Tony Cheung, Tommie Cornelius, Diana M. Batten, Christopher Eden, Shannon M.
|
bshanks@112 | 811 Norland, Dennis S. Rice, Nilesh Dosooye, Sundeep Shakya, Perdeep Mehta, and Tom Cur-
|
bshanks@112 | 812 ran. BGEM: an in situ hybridization database of gene expression in the embryonic and adult
|
bshanks@112 | 813 mouse nervous system. PLoS Biology, 4(4):e86 EP –, April 2006.
|
bshanks@112 | 814 [15] Lydia Ng, Amy Bernard, Chris Lau, Caroline C Overly, Hong-Wei Dong, Chihchau Kuan,
|
bshanks@112 | 815 Sayan Pathak, Susan M Sunkin, Chinh Dang, Jason W Bohland, Hemant Bokil, Partha P
|
bshanks@112 | 816 Mitra, Luis Puelles, John Hohmann, David J Anderson, Ed S Lein, Allan R Jones, and Michael
|
bshanks@112 | 817 Hawrylycz. An anatomic gene expression atlas of the adult mouse brain. Nat Neurosci,
|
bshanks@112 | 818 12(3):356–362, March 2009.
|
bshanks@112 | 819 [16] George Paxinos and Keith B.J. Franklin. The Mouse Brain in Stereotaxic Coordinates. Aca-
|
bshanks@112 | 820 demic Press, 2 edition, July 2001.
|
bshanks@112 | 821 [17] A. Schleicher, N. Palomero-Gallagher, P. Morosan, S. Eickhoff, T. Kowalski, K. Vos,
|
bshanks@112 | 822 K. Amunts, and K. Zilles. Quantitative architectural analysis: a new approach to cortical
|
bshanks@112 | 823 mapping. Anatomy and Embryology, 210(5):373–386, December 2005.
|
bshanks@112 | 824 [18] Oliver Schmitt, Lars Hmke, and Lutz Dmbgen. Detection of cortical transition regions utilizing
|
bshanks@112 | 825 statistical analyses of excess masses. NeuroImage, 19(1):42–63, May 2003.
|
bshanks@112 | 826 [19] S.B. Serpico and L. Bruzzone. A new search algorithm for feature selection in hyperspec-
|
bshanks@112 | 827 tral remote sensing images. Geoscience and Remote Sensing, IEEE Transactions on,
|
bshanks@112 | 828 39(7):1360–1367, 2001.
|
bshanks@112 | 829 17
|
bshanks@112 | 830
|
bshanks@112 | 831 [20] Constance M. Smith, Jacqueline H. Finger, Terry F. Hayamizu, Ingeborg J. McCright, Janan T.
|
bshanks@112 | 832 Eppig, James A. Kadin, Joel E. Richardson, and Martin Ringwald. The mouse gene expres-
|
bshanks@112 | 833 sion database (GXD): 2007 update. Nucl. Acids Res., 35(suppl_1):D618–623, 2007.
|
bshanks@112 | 834 [21] Larry Swanson. Brain Maps: Structure of the Rat Brain. Academic Press, 3 edition, November
|
bshanks@112 | 835 2003.
|
bshanks@112 | 836 [22] Carol L. Thompson, Sayan D. Pathak, Andreas Jeromin, Lydia L. Ng, Cameron R. MacPher-
|
bshanks@112 | 837 son, Marty T. Mortrud, Allison Cusick, Zackery L. Riley, Susan M. Sunkin, Amy Bernard,
|
bshanks@112 | 838 Ralph B. Puchalski, Fred H. Gage, Allan R. Jones, Vladimir B. Bajic, Michael J. Hawrylycz,
|
bshanks@112 | 839 and Ed S. Lein. Genomic anatomy of the hippocampus. Neuron, 60(6):1010–1021, Decem-
|
bshanks@112 | 840 ber 2008.
|
bshanks@112 | 841 [23] Pavel Tomancak, Amy Beaton, Richard Weiszmann, Elaine Kwan, ShengQiang Shu,
|
bshanks@112 | 842 Suzanna E Lewis, Stephen Richards, Michael Ashburner, Volker Hartenstein, Susan E Cel-
|
bshanks@112 | 843 niker, and Gerald M Rubin. Systematic determination of patterns of gene expression during
|
bshanks@112 | 844 drosophila embryogenesis. Genome Biology, 3(12):research008818814, 2002. PMC151190.
|
bshanks@112 | 845 [24] Shanmugasundaram Venkataraman, Peter Stevenson, Yiya Yang, Lorna Richardson,
|
bshanks@112 | 846 Nicholas Burton, Thomas P. Perry, Paul Smith, Richard A. Baldock, Duncan R. Davidson,
|
bshanks@112 | 847 and Jeffrey H. Christiansen. EMAGE edinburgh mouse atlas of gene expression: 2008 up-
|
bshanks@112 | 848 date. Nucl. Acids Res., 36(suppl_1):D860–865, 2008.
|
bshanks@112 | 849 [25] Axel Visel, Christina Thaller, and Gregor Eichele. GenePaint.org: an atlas of gene expression
|
bshanks@112 | 850 patterns in the mouse embryo. Nucl. Acids Res., 32(suppl_1):D552–556, 2004.
|
bshanks@112 | 851 [26] Robert H Waterston, Kerstin Lindblad-Toh, Ewan Birney, Jane Rogers, Josep F Abril, Pankaj
|
bshanks@112 | 852 Agarwal, Richa Agarwala, Rachel Ainscough, Marina Alexandersson, Peter An, Stylianos E
|
bshanks@112 | 853 Antonarakis, John Attwood, Robert Baertsch, Jonathon Bailey, Karen Barlow, Stephan Beck,
|
bshanks@112 | 854 Eric Berry, Bruce Birren, Toby Bloom, Peer Bork, Marc Botcherby, Nicolas Bray, Michael R
|
bshanks@112 | 855 Brent, Daniel G Brown, Stephen D Brown, Carol Bult, John Burton, Jonathan Butler,
|
bshanks@112 | 856 Robert D Campbell, Piero Carninci, Simon Cawley, Francesca Chiaromonte, Asif T Chin-
|
bshanks@112 | 857 walla, Deanna M Church, Michele Clamp, Christopher Clee, Francis S Collins, Lisa L Cook,
|
bshanks@112 | 858 Richard R Copley, Alan Coulson, Olivier Couronne, James Cuff, Val Curwen, Tim Cutts,
|
bshanks@112 | 859 Mark Daly, Robert David, Joy Davies, Kimberly D Delehaunty, Justin Deri, Emmanouil T Der-
|
bshanks@112 | 860 mitzakis, Colin Dewey, Nicholas J Dickens, Mark Diekhans, Sheila Dodge, Inna Dubchak,
|
bshanks@112 | 861 Diane M Dunn, Sean R Eddy, Laura Elnitski, Richard D Emes, Pallavi Eswara, Eduardo
|
bshanks@112 | 862 Eyras, Adam Felsenfeld, Ginger A Fewell, Paul Flicek, Karen Foley, Wayne N Frankel, Lu-
|
bshanks@112 | 863 cinda A Fulton, Robert S Fulton, Terrence S Furey, Diane Gage, Richard A Gibbs, Gustavo
|
bshanks@112 | 864 Glusman, Sante Gnerre, Nick Goldman, Leo Goodstadt, Darren Grafham, Tina A Graves,
|
bshanks@112 | 865 Eric D Green, Simon Gregory, Roderic Guig, Mark Guyer, Ross C Hardison, David Haussler,
|
bshanks@112 | 866 Yoshihide Hayashizaki, LaDeana W Hillier, Angela Hinrichs, Wratko Hlavina, Timothy Holzer,
|
bshanks@112 | 867 Fan Hsu, Axin Hua, Tim Hubbard, Adrienne Hunt, Ian Jackson, David B Jaffe, L Steven John-
|
bshanks@112 | 868 son, Matthew Jones, Thomas A Jones, Ann Joy, Michael Kamal, Elinor K Karlsson, Donna
|
bshanks@112 | 869 Karolchik, Arkadiusz Kasprzyk, Jun Kawai, Evan Keibler, Cristyn Kells, W James Kent, An-
|
bshanks@112 | 870 drew Kirby, Diana L Kolbe, Ian Korf, Raju S Kucherlapati, Edward J Kulbokas, David Kulp,
|
bshanks@112 | 871 Tom Landers, J P Leger, Steven Leonard, Ivica Letunic, Rosie Levine, Jia Li, Ming Li, Chris-
|
bshanks@112 | 872 tine Lloyd, Susan Lucas, Bin Ma, Donna R Maglott, Elaine R Mardis, Lucy Matthews, Evan
|
bshanks@112 | 873 18
|
bshanks@112 | 874
|
bshanks@112 | 875 Mauceli, John H Mayer, Megan McCarthy, W Richard McCombie, Stuart McLaren, Kirsten
|
bshanks@112 | 876 McLay, John D McPherson, Jim Meldrim, Beverley Meredith, Jill P Mesirov, Webb Miller, Tra-
|
bshanks@112 | 877 cie L Miner, Emmanuel Mongin, Kate T Montgomery, Michael Morgan, Richard Mott, James C
|
bshanks@112 | 878 Mullikin, Donna M Muzny, William E Nash, Joanne O Nelson, Michael N Nhan, Robert Nicol,
|
bshanks@112 | 879 Zemin Ning, Chad Nusbaum, Michael J O’Connor, Yasushi Okazaki, Karen Oliver, Emma
|
bshanks@112 | 880 Overton-Larty, Lior Pachter, Gens Parra, Kymberlie H Pepin, Jane Peterson, Pavel Pevzner,
|
bshanks@112 | 881 Robert Plumb, Craig S Pohl, Alex Poliakov, Tracy C Ponce, Chris P Ponting, Simon Potter,
|
bshanks@112 | 882 Michael Quail, Alexandre Reymond, Bruce A Roe, Krishna M Roskin, Edward M Rubin, Alis-
|
bshanks@112 | 883 tair G Rust, Ralph Santos, Victor Sapojnikov, Brian Schultz, Jrg Schultz, Matthias S Schwartz,
|
bshanks@112 | 884 Scott Schwartz, Carol Scott, Steven Seaman, Steve Searle, Ted Sharpe, Andrew Sheridan,
|
bshanks@112 | 885 Ratna Shownkeen, Sarah Sims, Jonathan B Singer, Guy Slater, Arian Smit, Douglas R Smith,
|
bshanks@112 | 886 Brian Spencer, Arne Stabenau, Nicole Stange-Thomann, Charles Sugnet, Mikita Suyama,
|
bshanks@112 | 887 Glenn Tesler, Johanna Thompson, David Torrents, Evanne Trevaskis, John Tromp, Cather-
|
bshanks@112 | 888 ine Ucla, Abel Ureta-Vidal, Jade P Vinson, Andrew C Von Niederhausern, Claire M Wade,
|
bshanks@112 | 889 Melanie Wall, Ryan J Weber, Robert B Weiss, Michael C Wendl, Anthony P West, Kris
|
bshanks@112 | 890 Wetterstrand, Raymond Wheeler, Simon Whelan, Jamey Wierzbowski, David Willey, Sophie
|
bshanks@112 | 891 Williams, Richard K Wilson, Eitan Winter, Kim C Worley, Dudley Wyman, Shan Yang, Shiaw-
|
bshanks@112 | 892 Pyng Yang, Evgeny M Zdobnov, Michael C Zody, and Eric S Lander. Initial sequencing and
|
bshanks@112 | 893 comparative analysis of the mouse genome. Nature, 420(6915):520–62, December 2002.
|
bshanks@112 | 894 PMID: 12466850.
|
bshanks@112 | 895 19
|
bshanks@112 | 896
|
bshanks@112 | 897
|