• ### eclipse IDE "Plugin execution not covered by lifecycle ..." solution

<pluginManagement>
    <plugins>
        <!--This plugin's configuration is used to store Eclipse m2e settings
            only. It has no influence on the Maven build itself. -->
        <plugin>
            <groupId>org.eclipse.m2e</groupId>
            <artifactId>lifecycle-mapping</artifactId>
            <version>1.0.0</version>
            <configuration>
                <lifecycleMappingMetadata>
                    <pluginExecutions>
                        <pluginExecution>
                            <pluginExecutionFilter>
                                <groupId>org.codehaus.mojo</groupId>
                                <artifactId>
                                    gwt-maven-plugin
                                </artifactId>
                                <versionRange>
                                    [2.5.1,)
                                </versionRange>
                                <goals>
                                    <goal>i18n</goal>
                                </goals>
                            </pluginExecutionFilter>
                            <action>
                                <ignore></ignore>
                            </action>
                        </pluginExecution>
                    </pluginExecutions>
                </lifecycleMappingMetadata>
            </configuration>
        </plugin>
    </plugins>
</pluginManagement>

# generate XXXX-tests.jar

<plugin>
	<groupId>org.apache.maven.plugins</groupId>
	<artifactId>maven-jar-plugin</artifactId>
	<version>2.2</version>
	<executions>
		<execution>
			<goals>
				<goal>test-jar</goal>
			</goals>
		</execution>
	</executions>
</plugin>

• ### install existed jar in local repository

<plugin>
	<artifactId>maven-install-plugin</artifactId>
	<version>2.3.1</version>
	<inherited>false</inherited>
	<executions>
		<execution>
			<id>install-kafka</id>
			<phase>validate</phase>
			<goals>
				<goal>install-file</goal>
			</goals>
			<configuration>
				<groupId>kafka</groupId>
				<artifactId>kafka</artifactId>
				<version>0.8-SNAPSHOT</version>
				<packaging>jar</packaging>
				<file>${basedir}/lib/kafka-0.8-SNAPSHOT.jar</file>
				<pomFile>${basedir}/lib/kafka-0.8-SNAPSHOT.xml</pomFile>
			</configuration>
		</execution>
		<execution>
			<id>install-avro-repo-client</id>
			<phase>validate</phase>
			<goals>
				<goal>install-file</goal>
			</goals>
			<configuration>
				<groupId>org.apache.avro</groupId>
				<artifactId>avro-repo-bundle</artifactId>
				<version>1.7.4-SNAPSHOT</version>
				<packaging>jar</packaging>
				<file>${basedir}/lib/avro-repo-bundle-1.7.4-SNAPSHOT-withdeps.jar</file>
				<pomFile>${basedir}/lib/avro-repo-bundle-1.7.4-SNAPSHOT-withdeps.xml</pomFile>
			</configuration>
		</execution>
	</executions>
</plugin>

• ### plugin

<plugin>
	<groupId>org.apache.maven.plugins</groupId>
	<artifactId>maven-compiler-plugin</artifactId>
	<configuration>
		<source>1.6</source>
		<target>1.6</target>
	</configuration>
</plugin>

该段代码加入pom.xml中就可以指定该project的jdk版本（可以被继承）

• ### JAVA_HOME

JAVA_HOME=$JAVA_HOME_15 mvn install   #	 run with 1.5
JAVA_HOME=$JAVA_HOME_16 mvn install   #	 run with 1.6

• ### 写引导区
  使用bootice写引导区
• ### tools
  • ImDisk Virtual Disk Driver
    imdisk是用来解决安装win7时找不到安装文件。虚拟win.iso=>CD_ROM
  • Config
    grub4dos - map /iso/cn_windows_7_ultimate_with_sp1_x64_dvd_u_677408.iso (hd32)
    需要iso在disk上连续存放
    BUG:Config -s xx.iso 命令时会提示找不到文件，可改成Config -s xx.iso*

    ---

    map --mem /iso/cn_windows_7_ultimate_with_sp1_x64_dvd_u_677408.iso (hd32)
    不会存在文件连续存放的问题,但需要内存足够大
• ### win7安装
  进入选择语言界面时，Shift + F10 进入cmd

Microsoft Windows  [版本 6.1.7600]
X:\Sources>pushd K:\imdisk
k:\imdisk>SetupImDisk.CMD
k:\imdisk>SetupCDROM.CMD path_to_win7_iso
k:\imdisk>

其他同CD安装

• install plugins

参考galileo-install-plug-ins-into-eclipse-ide

• share plugins

setting your eclipse.ini
-Dorg.eclipse.equinox.p2.reconciler.dropins.directory=C:/jvm/eclipse/mydropins

• install Plug-ins from old Eclipse Installations

参考following-eclipse-milestones
using the file chooser, browse to<OLD_ECLIPSE_PATH>/eclipse/p2/org.eclipse.equinox.p2.engine/profileRegistry/SDKProfile.profile/
and click Choose to select that directory

• disable a plugin

Some plugins allow controlling their load-on-startup behavior. These will be listed in the preferences, under General → Startup and Shutdown. If the plugin provides view, you will need to close those views (in all perspectives) for this to work.

This is an H1

This is an H2

This is an H1
=============

This is an H2
-------------

划线 ~~划线~~
这是一个普通段落。(两个空格+ENTER)段落中换行
这是一个普通段落。这是一个普通段落。这是一个普通段落。这是一个普通段落。

This is an H1

This is an H2

这是 H1

这是 H2

• ### install

  下载tar -xzf kafka_2.10-0.8.1.tgz
  tar -xzf kafka_2.10-0.8.1.tgz
  

  kafka_2.10-0.8.1.tgz中没有发现sbt,可以直接使用
  kafka-0.8.1-src.tgz中发现0.8.1使用了gradlew

• ### jars

  • 使用ZK目录中的ZK jar替换kafka libs/的ZK jar

  • ./kafka-producer-perf-test.sh 时发现缺少perf jar

    下载kafka-0.8.1-src.tgz
    修改gradle.properties中scalaVersion=2.10.0与kafka_2.10-0.8.1.tgz相匹配
    修改build.gradle的mavenCentral() to  maven{ url:"http://maven.oschina.net/content/groups/public/"}
    ./gradlew perf:jar
    copy kafka-0.8.1-src/perf/build/libs/kafka-perf_2.10-0.8.1.jar 到kafka的libs/
    

• ### server.properties

  • server.properties 分解成server.diff server.common
    server.diff 配置中不同的部分
    server.common 配置中相同的部分，方便在多台kafka服务器间同步

    #组成server.properties
    cat server.diff>server.properties && cat server.common>>server.properties
    

• ##### logdir目录结构
  • recovery-point-offset-checkpoint
    该文件对应类OffsetCheckpoint
    第1行：version 正常值为:0
    第2行：expectedSize
    第3行~第n行：topic partition offset
    expectedSize 应该为所有offset的和
  • replication-offset-checkpoint
  • .kafka_cleanshutdown
    如果有此文件表明kakfa正常关闭，log不需要recovery
  • topic dirs
    每个dir对应一个Log instance
    dir name: topic-partition
• ##### topic目录结构
  • startoffset.log
    对应类LogSegment
    每个topic有1～n个segment文件，startoffset为该segment的开始offset
    每个segment文件都有一个如之相对应的index文件
  • startoffset.index
    对应类OffsetIndex
  • startoffset.log.deleted
  • startoffset.index.deleted
  • startoffset.log.cleaned
  • startoffset.index.cleaned
  • startoffset.index.swap
  • startoffset.log.swap
• ##### 相关类
  • Log
• ##### LogManager参数
  • logDirs - log 所在的位置
  • topicConfigs - topic的特别配置
  • defaultConfig - log default config
  • cleanerConfig
  • flushCheckMs
  • flushCheckpointMs
  • retentionCheckMs
• ##### 主要property
  • logs - Pool[TopicAndPartition, Log]
  • recoveryPoints - logdir => OffsetCheckpoint
  • cleaner

### 目标
安装3台虚拟机作为hadoop,hive,storm的测试环境
### 配置
CPU:i7-3770K
RAM:32G
系统:win7 64
硬盘:4T raid0
### 安装虚拟机
开启CPU的虚拟，VT-X
虚拟机配置:
CPU:2个
RAM:4G
网络:桥连
系统:ubuntu 12.04
### 克隆虚拟机
克隆时选中重置网络MAC
修改eth0:/etc/udev/rules.d/70-persistent-net.rules,删除eth0的MAC,eth1的改成eth0
### 网络配置
IP:/etc/network/interfaces
auto eth0
iface eth0 inet static
address 10.1.9.21
gateway 10.1.9.254
netmask 255.255.255.0

/etc/init.d/networking restart

DNS:
add:/etc/resolvconf/resolv.conf.d/tail
	nameserver 202.106.46.151
	nameserver 202.106.0.20

/etc/init.d/resolvconf restart