hadoop2.6_windows_x64.zip

Hadoop Change Log Release 2.6.0 - 2014-11-18 INCOMPATIBLE CHANGES NEW FEATURES HADOOP-10433. Key Management Server based on KeyProvider API. (tucu) HADOOP-10893. isolated classloader on the client side (Sangjin Lee via jlowe) HADOOP-10400. Incorporate new S3A FileSystem implementation. (Jordan Mendelson and Dave Wang via atm) IMPROVEMENTS HADOOP-10808. Remove unused native code for munlock. (cnauroth) HADOOP-10815. Implement Windows equivalent of mlock. (cnauroth) HADOOP-7664. Remove warmings when overriding final parameter configuration if the override value is same as the final parameter value. (Ravi Prakash via suresh) HADOOP-10673. Update rpc metrics when the call throws an exception. (Ming Ma via jing9) HADOOP-10845. Add common tests for ACLs in combination with viewfs. (Stephen Chu via cnauroth) HADOOP-10839. Add unregisterSource() to MetricsSystem API. (Shanyu Zhao via cnauroth) HADOOP-10607. Create an API to separate credentials/password storage from applications (Larry McCay via omalley) HADOOP-10732. Fix locking in credential update. (Ted Yu via omalley) HADOOP-10733. Fix potential null dereference in CredShell. (Ted Yu via omalley) HADOOP-10610. Upgrade S3n s3.fs.buffer.dir to support multi directories. (Ted Malaska via atm) HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu) HADOOP-10755. Support negative caching of user-group mapping. (Lei Xu via wang) HADOOP-10855. Allow Text to be read with a known Length. (todd) HADOOP-10887. Add XAttrs to ViewFs and make XAttrs + ViewFileSystem internal dir behavior consistent. (Stephen Chu via wang) HADOOP-10882. Move DirectBufferPool into common util. (todd) HADOOP-8069. Enable TCP_NODELAY by default for IPC. (Todd Lipcon via Arpit Agarwal) HADOOP-10902. Deletion of directories with snapshots will not output reason for trash move failure. (Stephen Chu via wang) HADOOP-10900. CredentialShell args should use single-dash style. (wang) HADOOP-10903. Enhance hadoop classpath command to expand wildcards or write classpath into jar manifest. (cnauroth) HADOOP-10791. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) HADOOP-10771. Refactor HTTP delegation support out of httpfs to common. (tucu) HADOOP-10835. Implement HTTP proxyuser support in HTTP authentication client/server libraries. (tucu) HADOOP-10820. Throw an exception in GenericOptionsParser when passed an empty Path. (Alex Holmes and Zhihai Xu via wang) HADOOP-10281. Create a scheduler, which assigns schedulables a priority level. (Chris Li via Arpit Agarwal) HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw) HADOOP-10231. Add some components in Native Libraries document (Akira AJISAKA via aw) HADOOP-10650. Add ability to specify a reverse ACL (black list) of users and groups. (Benoy Antony via Arpit Agarwal) HADOOP-10335. An ip whilelist based implementation to resolve Sasl properties per connection. (Benoy Antony via Arpit Agarwal) HADOOP-10975. org.apache.hadoop.util.DataChecksum should support calculating checksums in native code (James Thomas via Colin Patrick McCabe) HADOOP-10201. Add listing to KeyProvider API. (Larry McCay via omalley) HADOOP-10177. Create CLI tools for managing keys. (Larry McCay via omalley) HADOOP-10432. Refactor SSLFactory to expose static method to determine HostnameVerifier. (tucu) HADOOP-10429. KeyStores should have methods to generate the materials themselves, KeyShell should use them. (tucu) HADOOP-10427. KeyProvider implementations should be thread safe. (tucu) HADOOP-10428. JavaKeyStoreProvider should accept keystore password via configuration falling back to ENV VAR. (tucu) HADOOP-10430. KeyProvider Metadata should have an optional description, there should be a method to retrieve the metadata from all keys. (tucu) HADOOP-10431. Change visibility of KeyStore.Options getter methods to public. (tucu) HADOOP-10534. KeyProvider getKeysMetadata should take a list of names rather than returning all keys. (omalley) HADOOP-10719. Add generateEncryptedKey and decryptEncryptedKey methods to KeyProvider. (asuresh via tucu) HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu) HADOOP-10881. Clarify usage of encryption and encrypted encryption key in KeyProviderCryptoExtension. (wang) HADOOP-10770. KMS add delegation token support. (tucu) HADOOP-10698. KMS, add proxyuser support. (tucu) HADOOP-8896. Javadoc points to Wrong Reader and Writer classes in SequenceFile (Ray Chiang via aw) HADOOP-10998. Fix bash tab completion code to work (Jim Hester via aw) HADOOP-10880. Move HTTP delegation tokens out of URL querystring to a header. (tucu) HADOOP-11005. Fix HTTP content type for ReconfigurationServlet. (Lei Xu via wang) HADOOP-10814. Update Tomcat version used by HttpFS and KMS to latest 6.x version. (rkanter via tucu) HADOOP-10994. KeyProviderCryptoExtension should use CryptoCodec for generation/decryption of keys. (tucu) HADOOP-11021. Configurable replication factor in the hadoop archive command. (Zhe Zhang via wang) HADOOP-11030. Define a variable jackson.version instead of using constant at multiple places. (Juan Yu via kasha) HADOOP-10990. Add missed NFSv3 request and response classes (brandonli) HADOOP-10863. KMS should have a blacklist for decrypting EEKs. (asuresh via tucu) HADOOP-11054. Add a KeyProvider instantiation based on a URI. (tucu) HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu) HADOOP-11060. Create a CryptoCodec test that verifies interoperability between the JCE and OpenSSL implementations. (hitliuyi via tucu) HADOOP-11070. Create MiniKMS for testing. (tucu) HADOOP-11057. checknative command to probe for winutils.exe on windows. (Xiaoyu Yao via cnauroth) HADOOP-10758. KMS: add ACLs on per key basis. (tucu) HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing. (Steve Lougran) HADOOP-10373 create tools/hadoop-amazon for aws/EMR support (stevel) HADOOP-11074. Move s3-related FS connector code to hadoop-aws (David S. Wang via Colin Patrick McCabe) HADOOP-11091. Eliminate old configuration parameter names from s3a (David S. Wang via Colin Patrick McCabe) HADOOP-10868. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu) HADOOP-10922. User documentation for CredentialShell. (Larry McCay via wang) HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu) HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang) HADOOP-10970. Cleanup KMS configuration keys. (wang) HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu) HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw) HADOOP-11101. How about inputstream close statement from catch block to finally block in FileContext#copy() ( skrho via vinayakumarb ) HADOOP-8808. Update FsShell documentation to mention deprecation of some of the commands, and mention alternatives (Akira AJISAKA via aw) HADOOP-10954. Adding site documents of hadoop-tools (Masatake Iwasaki via aw) HADOOP-10731. Remove @date JavaDoc comment in ProgramDriver class (Henry Saputra via aw) HADOOP-11153. M