第一章：绪论

下载：绪论

• 下载JDK（版本：Java 17）：https://www.oracle.com/java/technologies/downloads/
• 设置环境变量：

JAVA_HOME: C:\Program Files\Java\jdk-17.0.20.1
CLASSPATH: %JAVA_HOME%\lib\tools.jar;%JAVA_HOME%\lib\dt.jar;
PATH: %JAVA_HOME%\bin;%JAVA_HOME%\jre\bin;

• 测试是否安装成功

> java
> javac

• 下载（apache-maven-<version>-bin.zip或apache-maven-<version>-bin.tar.gz）：https://maven.apache.org/download.cgi
• 解压至某个目录，比如：d:\dev\maven
• 配置环境变量Path，新增d:\dev\maven\bin
• 验证是否安装成功

> mvn -v

• Repository路径配置（可选）：利用文本编辑器（比如：Sublime Text）打开Maven解压目录里中conf子目录下的settings.xml文件，配置localRepository项，实例如下：

<localRepository>D:/dev/maven/repo</localRepository>

• 下载：https://www.eclipse.org/downloads/
• 配置：Windows–>Preferences–>Maven
  • Installations: Add解压的Maven目录，并打上对勾，点击Apply；
  • User Settings: 在User Settings中选择Browse，选择Maven解压目录里中conf子目录下的settings.xml文件，点击Apply and Close。

• File–>Project–>Maven–>Maven Project，点击Next；
• 点击Next；
• 修改Use default Workspace location，或直接点击Next；
• 选择maven-archetype-quickstart，点击Next；
• 输入Group Id（例如：cn.edu.bjut.textmining），Artifact Id（例如：JavaTextMining）和Package（例如：cn.edu.bjut.textmining.chapter1），点击Finish。

pom.xml

<project xmlns="http://maven.apache.org/POM/4.0.0"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
	<modelVersion>4.0.0</modelVersion>
 
	<groupId>cn.edu.bjut.textmining</groupId>
	<artifactId>JavaTextMining</artifactId>
	<version>0.0.1-SNAPSHOT</version>
	<packaging>jar</packaging>
 
	<name>textming</name>
	<url>http://maven.apache.org</url>
 
	<properties>
		<maven.compiler.source>17</maven.compiler.source>
		<maven.compiler.target>17</maven.compiler.target>
		<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
	</properties>
 
	<dependencies>
		<dependency>
			<groupId>junit</groupId>
			<artifactId>junit</artifactId>
			<version>3.8.1</version>
			<scope>test</scope>
		</dependency>
		<dependency>
			<groupId>org.slf4j</groupId>
			<artifactId>slf4j-simple</artifactId>
			<version>2.0.18</version>
		</dependency>
		<dependency>
			<groupId>org.apache.opennlp</groupId>
			<artifactId>opennlp-tools</artifactId>
			<version>2.3.0</version>
		</dependency>
		<dependency>
			<groupId>org.apache.commons</groupId>
			<artifactId>commons-lang3</artifactId>
			<version>3.12.0</version>
		</dependency>
		<dependency>
			<groupId>commons-io</groupId>
			<artifactId>commons-io</artifactId>
			<version>2.11.0</version>
		</dependency>
		<dependency>
			<groupId>org.jsoup</groupId>
			<artifactId>jsoup</artifactId>
			<version>1.22.2</version>
		</dependency>
		<dependency>
			<groupId>org.apache.lucene</groupId>
			<artifactId>lucene-core</artifactId>
			<version>8.11.2</version>
		</dependency>
		<dependency>
			<groupId>org.apache.lucene</groupId>
			<artifactId>lucene-analyzers-common</artifactId>
			<version>8.11.2</version>
		</dependency>
	</dependencies>
</project>

TokenizerExample.java

package cn.edu.bjut.textmining.chapter1;
 
import opennlp.tools.tokenize.SimpleTokenizer;
 
public class TokenizerExample {
	public static void main(String[] args) {
		String text = "Text analysis and text mining are amazing!";
		SimpleTokenizer tokenizer = SimpleTokenizer.INSTANCE;
 
		System.out.println("Tokens:");
		String[] tokens = tokenizer.tokenize(text);
		for (String token : tokens) {
			System.out.println(token);
		}
	}
}