Click here to Skip to main content
15,886,664 members

Comments by oula alsheikh (Top 53 by date)

oula alsheikh 14-Dec-16 16:24pm View    
you mentioned that when we overwrite a file content by new data
,new data will not be written on original data sectors in NTFS
So NTFS remarked the old data as deleted and creates new data as a new file
so overwriting a file with n bytes will need 2n or maybe more bytes for old and new data
have any links please

assuming that we are going to write on a file then deleting it
what about streamwriter method does it work by same mechanism
and is it specific for text files or it can handle any other types of files
oula alsheikh 24-May-16 4:19am View    
if we encounter the following exception
in the following code what does it mean
i found no helpful definitions

the exception is

External Data Source information could not be retrieved due to an internal error Exception of type 'JNI.JavaExceptionCheckException' was thrown.: Error [Call From MIS-PC12/192.168.4.132 to 192.168.4.116:8020 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused] occurred while accessing external file..


and the code is

CREATE EXTERNAL DATA SOURCE MyHadoopCluster2 WITH (
TYPE = HADOOP,
LOCATION ='hdfs://192.168.4.116:8020',
RESOURCE_MANAGER_LOCATION = '192.168.4.116:8020'

);
GO
CREATE EXTERNAL FILE FORMAT TextFileFormat2 WITH (
FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS (FIELD_TERMINATOR ='|'));




CREATE EXTERNAL TABLE [dbo].[CarSensor_Data] (
[SensorKey] int NOT NULL,
[CustomerKey] int NOT NULL,
[GeographyKey] int NULL,
[Speed] float NOT NULL,
[YearMeasured] int NOT NULL
)
WITH (LOCATION='/D:\/',
DATA_SOURCE = MyHadoopCluster2,
FILE_FORMAT = TextFileFormat2

);

i don't know the location of the hadoop database is that the reason
oula alsheikh 24-May-16 4:18am View    
if we encounter the following exception
in the following code what does it mean
i found no helpful definitions

the exception is

External Data Source information could not be retrieved due to an internal error Exception of type 'JNI.JavaExceptionCheckException' was thrown.: Error [Call From MIS-PC12/192.168.4.132 to 192.168.4.116:8020 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused] occurred while accessing external file..


and the code is

CREATE EXTERNAL DATA SOURCE MyHadoopCluster2 WITH (
TYPE = HADOOP,
LOCATION ='hdfs://192.168.4.116:8020',
RESOURCE_MANAGER_LOCATION = '192.168.4.116:8020'

);
GO
CREATE EXTERNAL FILE FORMAT TextFileFormat2 WITH (
FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS (FIELD_TERMINATOR ='|'));




CREATE EXTERNAL TABLE [dbo].[CarSensor_Data] (
[SensorKey] int NOT NULL,
[CustomerKey] int NOT NULL,
[GeographyKey] int NULL,
[Speed] float NOT NULL,
[YearMeasured] int NOT NULL
)
WITH (LOCATION='/D:\/',
DATA_SOURCE = MyHadoopCluster2,
FILE_FORMAT = TextFileFormat2

);

i don't know the location of the hadoop database is that the reason
oula alsheikh 23-May-16 7:08am View    
look at this please
when writing this statement i got the following error
here is my question to use this statement should i move to hadoop location first then execute the statement or writing this statement means that we are in the middle of hadoop engine
login as: root
root@192.168.4.116's password:
Last login: Mon May 23 11:05:55 2016 from 192.168.4.20
[root@sandbox ~]# hadoop fs -mkdir /user/hadoop/dir1
mkdir: Call From sandbox.hortonworks.com/127.0.0.1 to sandbox.hortonworks.com:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
[root@sandbox ~]#
oula alsheikh 10-Mar-16 6:46am View    
of course we do it alot of times
you mean forcible close